Apr 11 22:58:09 user devstack@n-api.service[61858]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 22:58:09 user devstack@n-api.service[61858]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 22:58:09 2023] *** Apr 11 22:58:09 user devstack@n-api.service[61858]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 22:58:09 user devstack@n-api.service[61858]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 22:58:09 user devstack@n-api.service[61858]: nodename: user Apr 11 22:58:09 user devstack@n-api.service[61858]: machine: x86_64 Apr 11 22:58:09 user devstack@n-api.service[61858]: clock source: unix Apr 11 22:58:09 user devstack@n-api.service[61858]: pcre jit disabled Apr 11 22:58:09 user devstack@n-api.service[61858]: detected number of CPU cores: 12 Apr 11 22:58:09 user devstack@n-api.service[61858]: current working directory: / Apr 11 22:58:09 user devstack@n-api.service[61858]: detected binary path: /usr/bin/uwsgi-core Apr 11 22:58:09 user devstack@n-api.service[61858]: your processes number limit is 63637 Apr 11 22:58:09 user devstack@n-api.service[61858]: your memory page size is 4096 bytes Apr 11 22:58:09 user devstack@n-api.service[61858]: detected max file descriptor number: 2048 Apr 11 22:58:09 user devstack@n-api.service[61858]: lock engine: pthread robust mutexes Apr 11 22:58:09 user devstack@n-api.service[61858]: thunder lock: enabled Apr 11 22:58:09 user devstack@n-api.service[61858]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 22:58:09 user devstack@n-api.service[61858]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 22:58:09 user devstack@n-api.service[61858]: Python main interpreter initialized at 0x55f878339990 Apr 11 22:58:09 user devstack@n-api.service[61858]: python threads support enabled Apr 11 22:58:09 user devstack@n-api.service[61858]: your server socket listen backlog is limited to 100 connections Apr 11 22:58:09 user devstack@n-api.service[61858]: your mercy for graceful operations on workers is 90 seconds Apr 11 22:58:09 user devstack@n-api.service[61858]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 22:58:09 user devstack@n-api.service[61858]: *** Operational MODE: preforking *** Apr 11 22:58:09 user devstack@n-api.service[61858]: *** uWSGI is running in multiple interpreter mode *** Apr 11 22:58:09 user devstack@n-api.service[61858]: spawned uWSGI master process (pid: 61858) Apr 11 22:58:09 user devstack@n-api.service[61858]: spawned uWSGI worker 1 (pid: 61859, cores: 1) Apr 11 22:58:09 user devstack@n-api.service[61858]: spawned uWSGI worker 2 (pid: 61860, cores: 1) Apr 11 22:58:09 user devstack@n-api.service[61858]: spawned uWSGI worker 3 (pid: 61861, cores: 1) Apr 11 22:58:09 user devstack@n-api.service[61858]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 22:58:10 user devstack@n-api.service[61860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 22:58:10 user devstack@n-api.service[61861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 22:58:10 user devstack@n-api.service[61859]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 22:58:13 user devstack@n-api.service[61861]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 22:58:13 user devstack@n-api.service[61861]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 22:58:13 user devstack@n-api.service[61861]: and ``live_migration_inbound_addr`` respectively. Apr 11 22:58:13 user devstack@n-api.service[61861]: ). Its value may be silently ignored in the future. Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 22:58:13 user devstack@n-api.service[61859]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 22:58:13 user devstack@n-api.service[61859]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 22:58:13 user devstack@n-api.service[61859]: and ``live_migration_inbound_addr`` respectively. Apr 11 22:58:13 user devstack@n-api.service[61859]: ). Its value may be silently ignored in the future. Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 22:58:13 user devstack@n-api.service[61860]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 22:58:13 user devstack@n-api.service[61860]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 22:58:13 user devstack@n-api.service[61860]: and ``live_migration_inbound_addr`` respectively. Apr 11 22:58:13 user devstack@n-api.service[61860]: ). Its value may be silently ignored in the future. Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61861) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: INFO dbcounter [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Registered counter for database nova_api Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61859) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61861) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61860) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writer thread running {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG nova.context [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a93e25b-84a6-4387-9884-7b542e9fed94(cell1) {{(pid=61861) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61861]: INFO dbcounter [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61859]: INFO dbcounter [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Registered counter for database nova_api Apr 11 22:58:13 user devstack@n-api.service[61861]: INFO dbcounter [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Registered counter for database nova_cell1 Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61861) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61861) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writer thread running {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_db.sqlalchemy.engines [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61859) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writer thread running {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61860]: INFO dbcounter [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Registered counter for database nova_api Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_db.sqlalchemy.engines [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61860) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG nova.context [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a93e25b-84a6-4387-9884-7b542e9fed94(cell1) {{(pid=61859) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writer thread running {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61859]: INFO dbcounter [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61859]: INFO dbcounter [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Registered counter for database nova_cell1 Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_db.sqlalchemy.engines [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61859) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writer thread running {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_db.sqlalchemy.engines [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61859) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writer thread running {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61861]: INFO dbcounter [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG nova.context [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a93e25b-84a6-4387-9884-7b542e9fed94(cell1) {{(pid=61860) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61861) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:58:13 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writer thread running {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:58:13 user devstack@n-api.service[61860]: INFO dbcounter [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61860]: INFO dbcounter [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Registered counter for database nova_cell1 Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_db.sqlalchemy.engines [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61860) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writer thread running {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_db.sqlalchemy.engines [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61860) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writer thread running {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61859]: INFO dbcounter [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG oslo_db.sqlalchemy.engines [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61859) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writer thread running {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writer thread running {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:13 user devstack@n-api.service[61860]: INFO dbcounter [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Registered counter for database nova_cell0 Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG oslo_db.sqlalchemy.engines [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61860) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 22:58:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writer thread running {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 22:58:14 user devstack@n-api.service[61861]: WARNING keystonemiddleware.auth_token [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61861]: WARNING keystonemiddleware.auth_token [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61859]: WARNING keystonemiddleware.auth_token [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61861]: WARNING keystonemiddleware.auth_token [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61859]: WARNING keystonemiddleware.auth_token [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61861]: WARNING keystonemiddleware.auth_token [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61861]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f878339990 pid: 61861 (default app) Apr 11 22:58:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:58:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.003015 Apr 11 22:58:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 22:58:14 2023] GET /compute/v2.1/ => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:58:14 user devstack@n-api.service[61860]: WARNING keystonemiddleware.auth_token [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61860]: WARNING keystonemiddleware.auth_token [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61859]: WARNING keystonemiddleware.auth_token [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61859]: WARNING keystonemiddleware.auth_token [None req-7307df9e-9f19-4887-8245-1614c9a8bb97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61859]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f878339990 pid: 61859 (default app) Apr 11 22:58:14 user devstack@n-api.service[61860]: WARNING keystonemiddleware.auth_token [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 22:58:14 user devstack@n-api.service[61860]: WARNING keystonemiddleware.auth_token [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 22:58:14 user devstack@n-api.service[61860]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f878339990 pid: 61860 (default app) Apr 11 23:00:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5d1e6670-5472-494f-915f-ca3264ff267b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001749 Apr 11 23:00:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9c87283e-868d-4843-af6f-1e1e06aea86b admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9c87283e-868d-4843-af6f-1e1e06aea86b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.368683 Apr 11 23:00:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 23:00:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002268 Apr 11 23:00:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:25 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-73dde695-6b3f-4e0a-b8ec-00f149ab2ac1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-73dde695-6b3f-4e0a-b8ec-00f149ab2ac1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.354111 Apr 11 23:00:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:25 2023] POST /compute/v2.1/flavors => generated 405 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ce4ebbac-46f8-4150-8e63-ac2632b14bb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ce4ebbac-46f8-4150-8e63-ac2632b14bb1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052152 Apr 11 23:00:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 23:00:25 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001508 Apr 11 23:00:27 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3516ed7f-618a-497f-bffc-0c5e6557a31f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3516ed7f-618a-497f-bffc-0c5e6557a31f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063849 Apr 11 23:00:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:27 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5bc576bb-56eb-4a26-b68f-c3fa74078f53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5bc576bb-56eb-4a26-b68f-c3fa74078f53 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029849 Apr 11 23:00:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 23:00:27 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:00:29 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:29 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001428 Apr 11 23:00:29 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0d7930e4-4383-4b89-9ff2-3eb4cae94195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:29 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0d7930e4-4383-4b89-9ff2-3eb4cae94195 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.117779 Apr 11 23:00:29 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:29 2023] POST /compute/v2.1/flavors => generated 402 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-06d0af68-a4f4-43e9-b056-9d33c6043b64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-06d0af68-a4f4-43e9-b056-9d33c6043b64 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060457 Apr 11 23:00:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 23:00:29 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001498 Apr 11 23:00:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:31 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-63d30112-d507-44c0-b473-e02c63a35ca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-63d30112-d507-44c0-b473-e02c63a35ca5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.149854 Apr 11 23:00:31 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-29e5b3ad-940d-4135-b5ec-aee74aec7ed5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-29e5b3ad-940d-4135-b5ec-aee74aec7ed5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024997 Apr 11 23:00:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 23:00:31 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001790 Apr 11 23:00:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:33 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-697a5aae-c610-4b5d-a297-0561f14a66f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-697a5aae-c610-4b5d-a297-0561f14a66f5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060962 Apr 11 23:00:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:33 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028263 Apr 11 23:00:33 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 23:00:33 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eebb8ac5-2a15-4d7f-9894-892f19c71b3f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002532 Apr 11 23:00:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:35 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:35 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-777a457e-5aa5-49cb-a6f1-423023824cd3 admin admin] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:35 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-777a457e-5aa5-49cb-a6f1-423023824cd3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.115843 Apr 11 23:00:35 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 23:00:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:00:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001901 Apr 11 23:00:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:00:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-07ad04e7-7d62-495f-8e04-6e8634156dbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-07ad04e7-7d62-495f-8e04-6e8634156dbe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.322527 Apr 11 23:00:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:37 2023] POST /compute/v2.1/flavors => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3a708293-cf73-48f8-a6fa-8a97c69d3548 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3a708293-cf73-48f8-a6fa-8a97c69d3548 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049356 Apr 11 23:00:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 23:00:38 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001460 Apr 11 23:00:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:40 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8b09db5b-910a-4d0c-b7a9-f736bd7fcc91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "name": "m1.small"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:40 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8b09db5b-910a-4d0c-b7a9-f736bd7fcc91 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060642 Apr 11 23:00:40 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:40 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4b1de7fa-e138-4709-acc7-50415b25551b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:40 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4b1de7fa-e138-4709-acc7-50415b25551b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028501 Apr 11 23:00:40 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 23:00:40 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001516 Apr 11 23:00:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-452f95ab-00aa-4b4b-a7b8-0a4c33efe738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-452f95ab-00aa-4b4b-a7b8-0a4c33efe738 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063113 Apr 11 23:00:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:42 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-80ca07de-aae0-4293-952b-74867dd23197 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-80ca07de-aae0-4293-952b-74867dd23197 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025248 Apr 11 23:00:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 23:00:42 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001541 Apr 11 23:00:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9b33114e-0160-4803-885e-7a7d21811b4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "id": "4", "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9b33114e-0160-4803-885e-7a7d21811b4c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059053 Apr 11 23:00:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7b97925c-3606-4a18-8142-d4c1585b613d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7b97925c-3606-4a18-8142-d4c1585b613d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025390 Apr 11 23:00:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 23:00:44 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:00:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:00:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001476 Apr 11 23:00:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 23:00:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:00:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1c1146f3-4403-4cd0-aa87-accb8e2b9af9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1c1146f3-4403-4cd0-aa87-accb8e2b9af9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060922 Apr 11 23:00:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 23:00:46 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:00:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5240d0a8-6c53-4d23-b2a3-96046a93b041 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:00:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5240d0a8-6c53-4d23-b2a3-96046a93b041 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026493 Apr 11 23:00:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 23:00:46 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:01:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3fd544c0-cd8e-42ff-b9c9-63caf06d3e09 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002148 Apr 11 23:01:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 23:01:18 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:01:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:01:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.085805 Apr 11 23:01:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 23:01:18 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:01:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5240d0a8-6c53-4d23-b2a3-96046a93b041 admin admin] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5240d0a8-6c53-4d23-b2a3-96046a93b041 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002667 Apr 11 23:01:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 23:01:50 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:01:50 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:01:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-872788c6-a1fd-4021-a41c-21ccdfebdc62 admin admin] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-872788c6-a1fd-4021-a41c-21ccdfebdc62 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.073887 Apr 11 23:01:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 23:01:50 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:01:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001471 Apr 11 23:01:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 23:01:54 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:01:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:01:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5afe5d2e-f872-4338-aa67-00a7a1e6563b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.nano", "ram": 128, "rxtx_factor": 1.0, "id": "42", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:01:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5afe5d2e-f872-4338-aa67-00a7a1e6563b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068193 Apr 11 23:01:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 23:01:54 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:01:54 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cf46f61b-be6c-4d7a-957b-02f3217e72d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:01:54 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-cf46f61b-be6c-4d7a-957b-02f3217e72d6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024917 Apr 11 23:01:54 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 23:01:54 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:01:58 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:01:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d49a0f42-dde7-49c5-ae40-1a247ec8db98 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001472 Apr 11 23:01:58 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 23:01:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:01:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-361eae78-b775-48fb-93ab-d1e10313108a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.micro", "ram": 192, "id": "84", "vcpus": 1}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:01:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-361eae78-b775-48fb-93ab-d1e10313108a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071491 Apr 11 23:01:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 23:01:58 2023] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:01:59 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9d92bd86-c288-4ea5-bc42-aa0a90937286 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:01:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9d92bd86-c288-4ea5-bc42-aa0a90937286 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026521 Apr 11 23:01:59 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 23:01:59 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:04:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-400a971f-ac10-47c1-bf97-da02c5b17dcf tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Action: 'create', calling method: .version_select at 0x7f31588a51b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-301359598", "metadata": {"Type": "work"}}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-400a971f-ac10-47c1-bf97-da02c5b17dcf tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.672953 Apr 11 23:04:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 23:04:10 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1675 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 23:04:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:11 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-57d905c5-39be-46e0-8963-716144ed1301 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f315884b910>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-57d905c5-39be-46e0-8963-716144ed1301 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 200 len: 352 microversion: 2.1 time: 0.256042 Apr 11 23:04:12 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:11 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1a7c01d2-334e-4864-91e8-7afb6a0b6c0f tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f31589aaef0>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1a7c01d2-334e-4864-91e8-7afb6a0b6c0f tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 200 len: 353 microversion: 2.1 time: 0.193231 Apr 11 23:04:13 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:13 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5f23ccf1-eac2-417d-a8b6-4db480758280 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f31587340d0>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5f23ccf1-eac2-417d-a8b6-4db480758280 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 200 len: 353 microversion: 2.1 time: 0.075433 Apr 11 23:04:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:13 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4fa5feda-7b26-4bdb-8272-04d3681b6ec7 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f315872bc70>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4fa5feda-7b26-4bdb-8272-04d3681b6ec7 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 202 len: 0 microversion: 2.1 time: 0.108978 Apr 11 23:04:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:04:13 2023] DELETE /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:04:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-15788d71-c0f6-42b7-83d7-201ab227679d tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f3158717490>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-15788d71-c0f6-42b7-83d7-201ab227679d tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 200 len: 352 microversion: 2.1 time: 0.057849 Apr 11 23:04:13 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:13 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b13a8b2c-3452-47d6-b4be-c3ad2b906ea9 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f3158734790>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b13a8b2c-3452-47d6-b4be-c3ad2b906ea9 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 200 len: 352 microversion: 2.1 time: 0.052292 Apr 11 23:04:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:14 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e4273275-9f43-4d47-8631-5542805af658 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Calling method '.version_select at 0x7f31587403a0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-e4273275-9f43-4d47-8631-5542805af658 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] HTTP exception thrown: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. Apr 11 23:04:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e4273275-9f43-4d47-8631-5542805af658 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Request method failure captured: Apr 11 23:04:15 user devstack@n-api.service[61861]: request: GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 HTTP/1.1 Apr 11 23:04:15 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:04:15 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:04:15 user devstack@n-api.service[61861]: Connection: close Apr 11 23:04:15 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:04:15 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:04:15 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:04:15 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:04:15 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNedq_zUmbASkfYFDazVsGOvHN01uiiuURWzgPqSOZfBR5alfTxXHm7I9Z_cXKG0i5kPZtI4cKHQAnO_e0J2MV1szVh0bYSnWOFg8O78y4c1BLqD9-a1g8prHu_rRskPlcvZBMciaWNGCs_48o132fJR-1OLv9XXGdQA6AVkFGV0lH_4 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Project-Id: b95cc4c10ca94768be94d52c8d41b648 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesGetTestJSON-156433137 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b95cc4c10ca94768be94d52c8d41b648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b95cc4c10ca94768be94d52c8d41b648"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b95cc4c10ca94768be94d52c8d41b648"}]}] Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesGetTestJSON-156433137 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Tenant-Id: b95cc4c10ca94768be94d52c8d41b648 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesGetTestJSON-156433137 Apr 11 23:04:15 user devstack@n-api.service[61861]: X-User: tempest-VolumesGetTestJSON-156433137-project-member Apr 11 23:04:15 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:04:15 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:04:15 user devstack@n-api.service[61861]: X-User-Id: cc8864c23d89479a93d723f0c912046f Apr 11 23:04:15 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesGetTestJSON-156433137-project-member Apr 11 23:04:15 user devstack@n-api.service[61861]: method: Apr 11 23:04:15 user devstack@n-api.service[61861]: exception: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. Apr 11 23:04:15 user devstack@n-api.service[61861]: action_args: {'id': '168d3dd7-896b-40b9-9f3c-fdc51e1062e7'} Apr 11 23:04:15 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. (HTTP 404) (Request-ID: req-b16b9f4c-9cd8-4426-8e43-8453e46e2407) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. Apr 11 23:04:15 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e4273275-9f43-4d47-8631-5542805af658 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] Returning 404 to user: Volume 168d3dd7-896b-40b9-9f3c-fdc51e1062e7 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e4273275-9f43-4d47-8631-5542805af658 tempest-VolumesGetTestJSON-156433137 tempest-VolumesGetTestJSON-156433137-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7" status: 404 len: 109 microversion: 2.1 time: 0.049535 Apr 11 23:04:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:15 2023] GET /compute/v2.1/os-volumes/168d3dd7-896b-40b9-9f3c-fdc51e1062e7 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:04:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a9c23335-cfc5-439b-909c-183d978052b5 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Action: 'create', calling method: .version_select at 0x7f3158717ac0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-806901504", "metadata": {"Type": "work"}}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a9c23335-cfc5-439b-909c-183d978052b5 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:18 user devstack@n-api.service[61859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 23:04:18 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:04:18 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:04:18 user devstack@n-api.service[61859]: Connection: close Apr 11 23:04:18 user devstack@n-api.service[61859]: Content-Length: 121 Apr 11 23:04:18 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:04:18 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:04:18 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:04:18 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61859]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61859]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:18 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61859]: Apr 11 23:04:18 user devstack@n-api.service[61859]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-806901504", "metadata": {"Type": "work"}}} Apr 11 23:04:18 user devstack@n-api.service[61859]: method: Apr 11 23:04:18 user devstack@n-api.service[61859]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61859]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-806901504', 'metadata': {'Type': 'work'}}}} Apr 11 23:04:18 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise error Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a9c23335-cfc5-439b-909c-183d978052b5 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a9c23335-cfc5-439b-909c-183d978052b5 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.161540 Apr 11 23:04:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 23:04:18 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:04:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d2f558fa-804a-4fea-a036-f25d19592ad1 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Action: 'create', calling method: .version_select at 0x7f3158734dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-180404805", "metadata": {"Type": "work"}}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d2f558fa-804a-4fea-a036-f25d19592ad1 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:18 user devstack@n-api.service[61860]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 23:04:18 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:04:18 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:04:18 user devstack@n-api.service[61860]: Connection: close Apr 11 23:04:18 user devstack@n-api.service[61860]: Content-Length: 119 Apr 11 23:04:18 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:04:18 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:04:18 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:04:18 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61860]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61860]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:18 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61860]: Apr 11 23:04:18 user devstack@n-api.service[61860]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-180404805", "metadata": {"Type": "work"}}} Apr 11 23:04:18 user devstack@n-api.service[61860]: method: Apr 11 23:04:18 user devstack@n-api.service[61860]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 23:04:18 user devstack@n-api.service[61860]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-180404805', 'metadata': {'Type': 'work'}}}} Apr 11 23:04:18 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise error Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi '0' Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 23:04:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d2f558fa-804a-4fea-a036-f25d19592ad1 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d2f558fa-804a-4fea-a036-f25d19592ad1 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012660 Apr 11 23:04:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 23:04:18 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:04:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-fea87e47-65d0-49f7-bffe-494524b2fb1e tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Action: 'create', calling method: .version_select at 0x7f3158741360>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1468053521", "metadata": {"Type": "work"}}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-fea87e47-65d0-49f7-bffe-494524b2fb1e tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:18 user devstack@n-api.service[61861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 23:04:18 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:04:18 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:04:18 user devstack@n-api.service[61861]: Connection: close Apr 11 23:04:18 user devstack@n-api.service[61861]: Content-Length: 119 Apr 11 23:04:18 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:04:18 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:04:18 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:04:18 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:18 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:18 user devstack@n-api.service[61861]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:04:18 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:04:18 user devstack@n-api.service[61861]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:18 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:18 user devstack@n-api.service[61861]: Apr 11 23:04:18 user devstack@n-api.service[61861]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1468053521", "metadata": {"Type": "work"}}} Apr 11 23:04:18 user devstack@n-api.service[61861]: method: Apr 11 23:04:18 user devstack@n-api.service[61861]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61861]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1468053521', 'metadata': {'Type': 'work'}}}} Apr 11 23:04:18 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise error Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi '' Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 23:04:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:04:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-fea87e47-65d0-49f7-bffe-494524b2fb1e tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-fea87e47-65d0-49f7-bffe-494524b2fb1e tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013885 Apr 11 23:04:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 23:04:18 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:04:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-83a15f00-190e-4746-89b1-e469e379fb85 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Calling method '.version_select at 0x7f3158728b80>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-83a15f00-190e-4746-89b1-e469e379fb85 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] HTTP exception thrown: Volume tempest-invalid-361095185 could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-83a15f00-190e-4746-89b1-e469e379fb85 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:19 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-361095185 HTTP/1.1 Apr 11 23:04:19 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:04:19 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:04:19 user devstack@n-api.service[61859]: Connection: close Apr 11 23:04:19 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:04:19 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:04:19 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:04:19 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:04:19 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61859]: method: Apr 11 23:04:19 user devstack@n-api.service[61859]: exception: Volume tempest-invalid-361095185 could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: action_args: {'id': 'tempest-invalid-361095185'} Apr 11 23:04:19 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-361095185 could not be found. (HTTP 404) (Request-ID: req-c36a4056-2a6f-43a2-ae00-39450d5db631) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-361095185 could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-361095185 could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-361095185 could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-83a15f00-190e-4746-89b1-e469e379fb85 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 404 to user: Volume tempest-invalid-361095185 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-83a15f00-190e-4746-89b1-e469e379fb85 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-361095185" status: 404 len: 98 microversion: 2.1 time: 0.046924 Apr 11 23:04:19 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 11 23:04:18 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-361095185 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 23:04:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-de892959-2f59-48b0-a37b-13470b086a57 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004586 Apr 11 23:04:19 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 23:04:19 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 23:04:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2ec3d41d-0b9b-4bf6-9547-13b7e9910ace tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007427 Apr 11 23:04:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 23:04:19 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 23:04:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c0410573-8df5-4f0e-837a-0528991500a9 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Calling method '.version_select at 0x7f315872a290>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-c0410573-8df5-4f0e-837a-0528991500a9 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] HTTP exception thrown: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c0410573-8df5-4f0e-837a-0528991500a9 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:19 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/os-volumes/860544cf-a6a2-468c-bb7f-85ff189a24ce HTTP/1.1 Apr 11 23:04:19 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:04:19 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:04:19 user devstack@n-api.service[61859]: Connection: close Apr 11 23:04:19 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:04:19 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:04:19 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:04:19 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:04:19 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:19 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61859]: method: Apr 11 23:04:19 user devstack@n-api.service[61859]: exception: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: action_args: {'id': '860544cf-a6a2-468c-bb7f-85ff189a24ce'} Apr 11 23:04:19 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. (HTTP 404) (Request-ID: req-427ed8b2-a8b4-4414-8bca-c62bf1cfda36) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. Apr 11 23:04:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c0410573-8df5-4f0e-837a-0528991500a9 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 404 to user: Volume 860544cf-a6a2-468c-bb7f-85ff189a24ce could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c0410573-8df5-4f0e-837a-0528991500a9 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/860544cf-a6a2-468c-bb7f-85ff189a24ce" status: 404 len: 109 microversion: 2.1 time: 0.036722 Apr 11 23:04:19 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:04:19 2023] DELETE /compute/v2.1/os-volumes/860544cf-a6a2-468c-bb7f-85ff189a24ce => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:04:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-125c5da1-313e-41fd-88d3-601a76a4d1b0 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Calling method '.version_select at 0x7f3158734280>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-125c5da1-313e-41fd-88d3-601a76a4d1b0 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] HTTP exception thrown: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. Apr 11 23:04:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-125c5da1-313e-41fd-88d3-601a76a4d1b0 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Request method failure captured: Apr 11 23:04:19 user devstack@n-api.service[61860]: request: GET /compute/v2.1/os-volumes/cb76acba-a88c-4a39-9570-8fc9a852fd9c HTTP/1.1 Apr 11 23:04:19 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:04:19 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:04:19 user devstack@n-api.service[61860]: Connection: close Apr 11 23:04:19 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:04:19 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:04:19 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:04:19 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:04:19 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNedybVaakYJ0oEQ-oG-7DpnGiDj-uydBBTgLpUr3TbhDlPcJLq7eLIZDodNTqGzpjYeJkcujx6HDVry2LU3UGdJQd7rJNJ6F1FKewz8wlt7Fp5c-ruAJpg65Ucz6cu7rlHeNrWA6PtxfFN17WAqHIOjHB1r8AJLXQ_15WhPkUtxZDmQ Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Project-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/068426502c7a43d58d9cb1270ad86f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/068426502c7a43d58d9cb1270ad86f2f"}]}] Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Tenant-Id: 068426502c7a43d58d9cb1270ad86f2f Apr 11 23:04:19 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesNegativeTest-863287048 Apr 11 23:04:19 user devstack@n-api.service[61860]: X-User: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:04:19 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:04:19 user devstack@n-api.service[61860]: X-User-Id: 2e5e35bd84eb4bf2b98ca7f148a3fc5d Apr 11 23:04:19 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesNegativeTest-863287048-project-member Apr 11 23:04:19 user devstack@n-api.service[61860]: method: Apr 11 23:04:19 user devstack@n-api.service[61860]: exception: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. Apr 11 23:04:19 user devstack@n-api.service[61860]: action_args: {'id': 'cb76acba-a88c-4a39-9570-8fc9a852fd9c'} Apr 11 23:04:19 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. (HTTP 404) (Request-ID: req-f43ffa5a-b830-4802-82ab-50d9cf7ec601) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. Apr 11 23:04:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:04:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-125c5da1-313e-41fd-88d3-601a76a4d1b0 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] Returning 404 to user: Volume cb76acba-a88c-4a39-9570-8fc9a852fd9c could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:04:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-125c5da1-313e-41fd-88d3-601a76a4d1b0 tempest-VolumesNegativeTest-863287048 tempest-VolumesNegativeTest-863287048-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cb76acba-a88c-4a39-9570-8fc9a852fd9c" status: 404 len: 109 microversion: 2.1 time: 0.057455 Apr 11 23:04:19 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:04:19 2023] GET /compute/v2.1/os-volumes/cb76acba-a88c-4a39-9570-8fc9a852fd9c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:04:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-dad72546-896f-480f-abd9-dd3f22193513 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: .version_select at 0x7f3158740dc0>, body: {"keypair": {"name": "tempest-keypair-1554463927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFXur1n5bySb89hFW0iZk/YKQGdOAYKMI7W2ac6H+X/rY4oycPVN2NaUo3y5klD+tcG0v96NNRmC+62KCvlRiFPb9aMdkUeQ5V1nCBUtO+uJfi9JTs1Qmn0IRNdl9V3Iw=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:31 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-dad72546-896f-480f-abd9-dd3f22193513 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:31 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-dad72546-896f-480f-abd9-dd3f22193513 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-dad72546-896f-480f-abd9-dd3f22193513 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308493 Apr 11 23:04:31 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 22/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:04:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-db0eb6fc-7248-45c7-8114-578febcab884 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'create', calling method: .version_select at 0x7f3158729ea0>, body: {"keypair": {"name": "tempest-keypair-24963563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE9QDWoeyAk5NPp++qY0mw94h70wgQ85QXWkrvjtaSwwpbB/vlw81NpI+lMUuo71+oPbM1g+FT373UgIfaZ8VyRJDzOgtgdrI0cP+MdyqWrhTvd1yMzfPZXk/mcG9NWEw=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:36 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-db0eb6fc-7248-45c7-8114-578febcab884 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting quotas for project 8550fae43fa54d9a99dedf1d8e3bf0d0. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:36 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-db0eb6fc-7248-45c7-8114-578febcab884 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting quotas for user e9e926b3053c4258a3340d19ae40a7a9 and project 8550fae43fa54d9a99dedf1d8e3bf0d0. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-db0eb6fc-7248-45c7-8114-578febcab884 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.353055 Apr 11 23:04:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:04:36 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1843582430", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:38 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] validate_networks() for [('02021ebc-33d0-4630-a873-2190cd8d8360', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:04:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1831107086", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f9e1c987-17bb-42a1-9005-96fcd25d79c0"}], "security_groups": [{"name": "tempest-securitygroup--1661352765"}], "key_name": "tempest-keypair-1554463927", "user_data": "}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting quotas for project 4c3e11fd040149dd8f5a130a9682a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting quotas for user 859ae6c19707455ebf82bf532c9e10c0 and project 4c3e11fd040149dd8f5a130a9682a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:04:41 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:04:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-da9c8d0a-3fc5-4278-8b01-a0097232b7b7 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.111563 Apr 11 23:04:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:04:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:04:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-641da3db-15a0-4990-bd72-221dfbf6c6c8 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:41 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-641da3db-15a0-4990-bd72-221dfbf6c6c8 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:04:41 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] validate_networks() for [('f9e1c987-17bb-42a1-9005-96fcd25d79c0', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:04:41 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:41 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-641da3db-15a0-4990-bd72-221dfbf6c6c8 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-641da3db-15a0-4990-bd72-221dfbf6c6c8 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1211 microversion: 2.1 time: 0.173638 Apr 11 23:04:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 22/65] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:04:41 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:04:43 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:04:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-cda31e8f-99c6-444e-8e56-97dcfd627623 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.013832 Apr 11 23:04:43 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:04:41 2023] POST /compute/v2.1/servers => generated 407 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:04:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d0ead84e-29dd-4ab7-b773-717f3039857e tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:43 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d0ead84e-29dd-4ab7-b773-717f3039857e tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:04:43 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-d0ead84e-29dd-4ab7-b773-717f3039857e tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d0ead84e-29dd-4ab7-b773-717f3039857e tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1233 microversion: 2.1 time: 0.220733 Apr 11 23:04:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:04:43 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1233 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:04:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-229868185", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "a4b59436-3706-4c0a-97c0-b11230ce2ee4"}], "security_groups": [{"name": "tempest-securitygroup--405117776"}], "key_name": "tempest-keypair-24963563", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:44 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] validate_networks() for [('a4b59436-3706-4c0a-97c0-b11230ce2ee4', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:04:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a0acf141-65ce-424d-87da-ec7273f0bd64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: .version_select at 0x7f31586acca0>, body: {"keypair": {"name": "tempest-keypair-208393987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhq2c1AASfEGyAAJl+QIGDBVlGaQd5aU2DpuWVUMd+VgtFnNGA30jaPJqm7CxuxKNS3cfyVDWuM5n3h/I+Opv2IF/BYKVBsSYfscd1VrAJJc1HvdHk6jRHnOOCv9avuqQ=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:44 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-a0acf141-65ce-424d-87da-ec7273f0bd64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for project b466a7e141a247319eae64ab30aca760. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:44 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-a0acf141-65ce-424d-87da-ec7273f0bd64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for user 7272af33be864737b2231127f4323638 and project b466a7e141a247319eae64ab30aca760. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a0acf141-65ce-424d-87da-ec7273f0bd64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.107830 Apr 11 23:04:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 24/68] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 23:04:44 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting quotas for project 8550fae43fa54d9a99dedf1d8e3bf0d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Getting quotas for user e9e926b3053c4258a3340d19ae40a7a9 and project 8550fae43fa54d9a99dedf1d8e3bf0d0. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:04:46 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:04:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d90a49f5-ca25-44fc-8b5a-d64ac929b59a tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.566863 Apr 11 23:04:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:04:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:04:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4c138a27-6d0e-4195-846b-a6a0e8f4f7dc tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:46 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4c138a27-6d0e-4195-846b-a6a0e8f4f7dc tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:04:46 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4c138a27-6d0e-4195-846b-a6a0e8f4f7dc tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4c138a27-6d0e-4195-846b-a6a0e8f4f7dc tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1237 microversion: 2.1 time: 0.165594 Apr 11 23:04:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:04:46 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Creating event network-changed:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61861) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3c2c1c44-558c-4621-8250-c4969fd23ceb req-e017b187-afec-471a-bd0d-cdaca3b5500d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61861) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:47 user devstack@n-api.service[61861]: INFO nova.compute.rpcapi [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 23:04:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] Releasing lock "compute-rpcapi-router" {{(pid=61861) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 23:04:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bec74fe3-7c3b-4c03-951f-452cd9756479 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137445 Apr 11 23:04:47 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Creating event network-changed:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61859) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef5a6e89-7ff8-4e3b-93b3-14405238b1aa req-649dac8d-ff02-4678-936d-d4363deddaf1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61859) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:50 user devstack@n-api.service[61859]: INFO nova.compute.rpcapi [None req-437def8f-e909-4903-af75-782e82745a8d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 23:04:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-437def8f-e909-4903-af75-782e82745a8d None None] Releasing lock "compute-rpcapi-router" {{(pid=61859) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 23:04:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-437def8f-e909-4903-af75-782e82745a8d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217497 Apr 11 23:04:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-742046125", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6af6f111-70ec-4fd4-8d8c-d05bd0886155"}], "security_groups": [{"name": "tempest-securitygroup--1360061956"}], "key_name": "tempest-keypair-208393987", "user_data": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:51 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:51 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:51 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] validate_networks() for [('6af6f111-70ec-4fd4-8d8c-d05bd0886155', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:04:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9b72bc46-0241-4b3f-9bef-b9c98ddd4645 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Action: 'create', calling method: .version_select at 0x7f3157d141f0>, body: {"keypair": {"name": "tempest-keypair-1401661035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8ODpXY5bZgmxO5t5Y4E36zk4OtZoXs0KgN3E2IDtgASaVQEDy8SuRh1bds0DVt6hO2bRftrq5qk08LxQJMvdhB80a5j4F6edXn56zcx8okMNhfO4isidv+PZkrEFpPhw=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:52 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-9b72bc46-0241-4b3f-9bef-b9c98ddd4645 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for project c24d77b00c084f6f857147717350b6e0. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:52 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-9b72bc46-0241-4b3f-9bef-b9c98ddd4645 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for user 340848f1de07428e85af2cf660943c3e and project c24d77b00c084f6f857147717350b6e0. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9b72bc46-0241-4b3f-9bef-b9c98ddd4645 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291290 Apr 11 23:04:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 26/73] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:04:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for project b466a7e141a247319eae64ab30aca760. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for user 7272af33be864737b2231127f4323638 and project b466a7e141a247319eae64ab30aca760. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:04:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:04:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0504a75e-638e-4910-b3df-7261c386e999 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.759869 Apr 11 23:04:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 24/74] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:04:51 2023] POST /compute/v2.1/servers => generated 400 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 11 23:04:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:04:53 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:04:53 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:53 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] Creating event network-changed:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:04:53 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:53 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:04:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-aa473a50-a0a5-45af-8698-705e341e6253 req-07118193-d3ca-4646-88c6-ea6a750437dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060392 Apr 11 23:04:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b0a69b60-1322-487f-9a01-c90cb367357a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1274 microversion: 2.20 time: 0.187638 Apr 11 23:04:53 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:04:52 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "name": "network-vif-plugged", "status": "completed", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Creating event network-vif-plugged:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61860) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6689c85f-40f3-453f-a9ff-f3bfc368ec60 req-8d253801-a4f1-428f-8b11-c0ab9201156e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61860) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:54 user devstack@n-api.service[61860]: INFO nova.compute.rpcapi [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 23:04:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61860) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 23:04:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-417e3a6f-812a-4d9b-933d-e5562db6fbc8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124242 Apr 11 23:04:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:55 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:04:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-0e6037c2-43ec-490d-9968-e00fbb2bcf17 req-2ca3ca11-c492-44a1-8f7e-731f0f25a439 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131992 Apr 11 23:04:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 28/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:55 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8a3088ff-5423-418c-ab77-44060d38b7c8 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Action: 'create', calling method: .version_select at 0x7f3157d15bd0>, body: {"keypair": {"name": "tempest-keypair-1498862326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcZSeQR7Wc+y8f0fYbTRcs8v3/VAfwZDXS0iV+9qSnNNj/GWc2eCD17bn79lZa3dYdLohcJtJ6JWgwR4YOz3w8nCzMZ9rJ5FuVmKT8eNb0z8wtI31+Z8kDZzhe6ZPQtuQ=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:55 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-8a3088ff-5423-418c-ab77-44060d38b7c8 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting quotas for project 204fa09429ce4f2fafbc532805a346bc. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:04:55 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-8a3088ff-5423-418c-ab77-44060d38b7c8 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting quotas for user 9554290c1a944393b68875dbadee5e63 and project 204fa09429ce4f2fafbc532805a346bc. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:04:55 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-8a3088ff-5423-418c-ab77-44060d38b7c8 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051957 Apr 11 23:04:55 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 26/79] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:04:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:56 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "name": "network-vif-plugged", "status": "completed", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] Creating event network-vif-plugged:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:04:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-717f28e2-1d1b-48fc-b228-ca316efc554f req-6abf79f2-765e-4252-bd34-746340d3f431 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041081 Apr 11 23:04:56 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:57 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:57 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:04:57 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-a189057d-c371-4111-abc2-1c1b6a5ba8bd req-59f39bf8-3a90-48d1-9c04-94e738aa38ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Apr 11 23:04:57 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 29/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:04:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] Creating event network-changed:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:04:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-94be576f-6a1a-4f99-82fa-b19f4101b67a req-14458953-fbb1-4dc0-8d10-751a959120e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063838 Apr 11 23:04:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:04:58 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-733558945", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "0678e3e7-49ce-4482-b828-84fd3ed1cf15"}], "security_groups": [{"name": "tempest-securitygroup--273972761"}], "key_name": "tempest-keypair-1401661035", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:58 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] validate_networks() for [('0678e3e7-49ce-4482-b828-84fd3ed1cf15', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:04:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}, {"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:04:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:04:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:04:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:04:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:04:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:04:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:04:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-b712d398-97db-439f-9e47-af43cc4daa3f req-43a9372a-6cd9-44a5-b52f-55096e68cd90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088947 Apr 11 23:04:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 30/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:04:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:00 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:05:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-502b42f1-f72a-4162-bbba-ebab3defd845 req-f349a22c-8a65-4899-bc48-59734666e94d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044104 Apr 11 23:05:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for project c24d77b00c084f6f857147717350b6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for user 340848f1de07428e85af2cf660943c3e and project c24d77b00c084f6f857147717350b6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ff36d958-708d-447a-acb3-006866b895b5 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.768690 Apr 11 23:05:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 27/85] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:04:58 2023] POST /compute/v2.1/servers => generated 403 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:05:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c7083c73-2f39-47e4-9bd6-8a783e6e1f1f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:00 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c7083c73-2f39-47e4-9bd6-8a783e6e1f1f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:01 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c7083c73-2f39-47e4-9bd6-8a783e6e1f1f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c7083c73-2f39-47e4-9bd6-8a783e6e1f1f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" status: 200 len: 1235 microversion: 2.1 time: 0.255081 Apr 11 23:05:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 31/86] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:00 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => generated 1235 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-2088061217", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "0c84d5db-4dde-46d7-8e55-dccce02872ee"}], "security_groups": [{"name": "tempest-securitygroup--1690692043"}], "key_name": "tempest-keypair-1498862326", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:05:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c6ec801e-8a39-48f5-8660-c8117f1b6088 req-6a8685b6-d321-4398-9062-22217c56cd17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152397 Apr 11 23:05:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:03 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] validate_networks() for [('0c84d5db-4dde-46d7-8e55-dccce02872ee', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting quotas for project 204fa09429ce4f2fafbc532805a346bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Getting quotas for user 9554290c1a944393b68875dbadee5e63 and project 204fa09429ce4f2fafbc532805a346bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f0d8fc03-7060-4380-854f-5a0f25d89be0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.606604 Apr 11 23:05:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 28/88] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:05:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 23:05:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c7cf536b-83bc-428d-9f2c-9c26ec167bc2 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c7cf536b-83bc-428d-9f2c-9c26ec167bc2 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:04 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:04 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c7cf536b-83bc-428d-9f2c-9c26ec167bc2 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9554290c1a944393b68875dbadee5e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204fa09429ce4f2fafbc532805a346bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c7cf536b-83bc-428d-9f2c-9c26ec167bc2 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687" status: 200 len: 1226 microversion: 2.1 time: 0.247597 Apr 11 23:05:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 32/89] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:04 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 => generated 1226 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:05 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=18 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-39455222-55c2-4185-ba0c-559224787aff tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Action: 'create', calling method: .version_select at 0x7f3157d17640>, body: {"keypair": {"name": "tempest-keypair-1505121934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrUyvv9xJhmprh9AK+up58UndvSccnxFuoMXv0YaoKFD6ViJ/cCVH/dZhQWHCTvniN/nJcx+Yxib3iT4OoYKuJjAnAkIXNDljHm3326qgsWCqfKYBDSjK9hSyBSEHpiew=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:05 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-39455222-55c2-4185-ba0c-559224787aff tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting quotas for project 13a01d410ba24128b6a884f317687a7d. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:05 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-39455222-55c2-4185-ba0c-559224787aff tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting quotas for user fe4793e0b50343c3b0795159dbcbf46b and project 13a01d410ba24128b6a884f317687a7d. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-39455222-55c2-4185-ba0c-559224787aff tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.366520 Apr 11 23:05:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:05:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-120038ba-5a99-4378-b733-3f26c3eee637 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Action: 'create', calling method: .version_select at 0x7f31586d3d90>, body: {"keypair": {"name": "tempest-keypair-1602402085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjYyFfjZ4jJzoYCxHNitzizXcyb+46lxif+p1WR3AxkPOuuDeeRO58EcoDOCV1AotgbxMzrZn7KKNU1EvmEh6aGyzyrtnw/YgTuT0xmESOl+oFG8zQeViLhG0BqUIwvWg=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:07 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-120038ba-5a99-4378-b733-3f26c3eee637 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting quotas for project 35fb372296e5430e9f915be720934494. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:07 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-120038ba-5a99-4378-b733-3f26c3eee637 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting quotas for user 343064f07762476ca5221be36dcbd0de and project 35fb372296e5430e9f915be720934494. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-120038ba-5a99-4378-b733-3f26c3eee637 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.075849 Apr 11 23:05:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 29/91] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 23:05:07 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:05:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1001345895", "imageRef": "593cabf7-840e-46c9-8f3d-2f5b1d39023f", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "89fffa37-15ee-4d3d-84ff-6a77c47b321d"}], "security_groups": [{"name": "tempest-securitygroup--1726093354"}], "key_name": "tempest-keypair-1505121934", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:08 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] Creating event network-changed:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:05:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3e4fcd3c-a8de-40c4-908f-9d33b9fddc17 req-078fcc45-9d99-4b37-aa80-58afe18cc1d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060043 Apr 11 23:05:08 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 33/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:08 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] validate_networks() for [('89fffa37-15ee-4d3d-84ff-6a77c47b321d', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=13 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting quotas for project 13a01d410ba24128b6a884f317687a7d. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Getting quotas for user fe4793e0b50343c3b0795159dbcbf46b and project 13a01d410ba24128b6a884f317687a7d. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='593cabf7-840e-46c9-8f3d-2f5b1d39023f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2d5400d8-0036-49df-92cb-1013d559290f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.351493 Apr 11 23:05:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:05:08 2023] POST /compute/v2.1/servers => generated 404 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:05:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-cb0465af-2577-410e-9d28-99da78f382e6 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-cb0465af-2577-410e-9d28-99da78f382e6 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=13 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:09 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-cb0465af-2577-410e-9d28-99da78f382e6 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4793e0b50343c3b0795159dbcbf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a01d410ba24128b6a884f317687a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=33 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-cb0465af-2577-410e-9d28-99da78f382e6 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 200 len: 1240 microversion: 2.1 time: 0.175878 Apr 11 23:05:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:09 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 1240 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:10 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] Creating event network-changed:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:05:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d2e796d3-0b69-4817-81a8-29b9b0bcb4f9 req-070d2936-501c-4cb9-9876-f326b9094204 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036613 Apr 11 23:05:10 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 34/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1742434033", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ec308915-bf10-473b-ae96-e2933989bb95"}], "security_groups": [{"name": "tempest-securitygroup--152096899"}], "key_name": "tempest-keypair-1602402085", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:10 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] validate_networks() for [('ec308915-bf10-473b-ae96-e2933989bb95', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting quotas for project 35fb372296e5430e9f915be720934494. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Getting quotas for user 343064f07762476ca5221be36dcbd0de and project 35fb372296e5430e9f915be720934494. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:11 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "name": "network-vif-plugged", "status": "completed", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2b742aeb-f5cc-4046-9281-a8e8ccbe5297 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.699128 Apr 11 23:05:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 32/96] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:05:10 2023] POST /compute/v2.1/servers => generated 403 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] Creating event network-vif-plugged:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:05:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-cb165d60-cd5b-46d0-ac37-f3d7db6e5679 req-628fdbef-15e4-4fa2-a8d8-459a18f57617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059387 Apr 11 23:05:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 31/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=19 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:11 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:11 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f68f088e-ca20-4f1a-a6d8-261a1e1dd33c tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 200 len: 1321 microversion: 2.49 time: 0.104044 Apr 11 23:05:11 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 35/98] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:05:11 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 1321 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:05:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "name": "network-vif-plugged", "status": "completed", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] Creating event network-vif-plugged:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:05:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0b1efb79-22ed-402f-bbc0-568a8af6ddb8 req-07c3ed27-5df1-40ca-8784-102f6dd45226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063112 Apr 11 23:05:13 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "name": "network-vif-plugged", "status": "completed", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] Creating event network-vif-plugged:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:05:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-438f4a65-581c-4103-964a-bf2767d2c68a req-8f992845-5c25-4dff-be9f-e160be9728d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039868 Apr 11 23:05:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "name": "network-vif-plugged", "status": "completed", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=19 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] Creating event network-vif-plugged:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:05:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-8243fbcb-15cd-4665-9988-b13b79819947 req-4e9cbeca-ff18-4832-b427-0b1b82796eaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061715 Apr 11 23:05:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 36/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:05:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] Creating event network-changed:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:05:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-8172583a-960c-4024-b3b0-104806c77a43 req-cacce69a-6be6-4dc6-a693-529af3f26060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041327 Apr 11 23:05:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:19 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] Creating event network-changed:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:05:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-edde4998-6e37-4d77-805b-ae2426dc87ed req-535618bc-0285-47e7-8585-6bc22ab392d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093913 Apr 11 23:05:19 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "name": "network-vif-plugged", "status": "completed", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}, {"server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "name": "network-vif-plugged", "status": "completed", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Creating event network-vif-plugged:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:05:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] Creating event network-vif-plugged:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:05:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-af92277d-bba7-4b29-ae8a-cad9f8d36ed5 req-a598d062-c7a5-4e37-8ab5-2b9d1a13e8e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048186 Apr 11 23:05:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 37/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}, {"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=16 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Creating event network-vif-plugged:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:05:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] Creating event network-vif-plugged:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:05:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-81d436a4-47ff-4308-b19d-505517560716 req-1e6e3e98-693e-4c20-b888-fec743fb18cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072453 Apr 11 23:05:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:05:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e857ca48-4894-4637-92dd-eb7fde4d44dd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Action: 'create', calling method: .version_select at 0x7f31586d2c20>, body: {"keypair": {"name": "tempest-keypair-1302009898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEZ9Uu8GECg23e5OXVg+MubXPfmeOpeza98oIYWIHVSuugceQa0zMJtPpSBueWyV0fTc+BWiWF+n4PLStwi2ed02oL62cExgT7y+jXor2t6H5L0D+NMbnbtk7bcRgGQ9w=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:24 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:24 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-e857ca48-4894-4637-92dd-eb7fde4d44dd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting quotas for project d2ea0b8c8a4b4a1cac18e97464975fab. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:24 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-e857ca48-4894-4637-92dd-eb7fde4d44dd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting quotas for user a6c3f5f97f8d4380a97913a14fda79df and project d2ea0b8c8a4b4a1cac18e97464975fab. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e857ca48-4894-4637-92dd-eb7fde4d44dd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.141234 Apr 11 23:05:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 34/106] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 23:05:24 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:05:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-95880f78-3640-4114-830f-54254e65c04d tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Action: 'create', calling method: .version_select at 0x7f3157d156c0>, body: {"keypair": {"name": "tempest-keypair-677934585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5Gt/4NMp8WPdvyXOg7I4dW1o4UCc/vrAlJenixGxP8moJlaW3F2gGu3o8glBWfRl7kpOxoB1F6e3el7BV3q/pFlhM/Bhh2bep8pLunx2Zd6K1f1u42Sw0JkDnoo3kQpw=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:24 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-95880f78-3640-4114-830f-54254e65c04d tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting quotas for project 4baaf4c6d66541b79d15d024804d934c. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:24 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-95880f78-3640-4114-830f-54254e65c04d tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting quotas for user 92d65920f60d4b0e811cf0bd7df65d35 and project 4baaf4c6d66541b79d15d024804d934c. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-95880f78-3640-4114-830f-54254e65c04d tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.088515 Apr 11 23:05:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 38/107] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 23:05:24 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:05:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905021876", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "982bf492-a432-431b-aa00-9cab35dd1b8a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1545591213", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a341e6d3-4f4c-44c5-a510-cd0b61eb81cd"}, {"port": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660", "tag": "port-1"}, {"port": "4f2220da-1007-4ae8-9c12-73a142b02b49", "tag": "port-2"}, {"uuid": "a781604b-df59-4e97-af90-76111c0cda1e", "tag": "net-1"}, {"uuid": "a781604b-df59-4e97-af90-76111c0cda1e"}, {"uuid": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2f3d8fb7-2270-4c7c-b1ef-63cb207587dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "39261de4-8b4d-4e01-b027-628663c9a7fd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--982461553"}], "key_name": "tempest-keypair-1302009898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:26 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:26 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] validate_networks() for [('a341e6d3-4f4c-44c5-a510-cd0b61eb81cd', None, None, None, None, None), (None, None, '9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660', None, None, None), (None, None, '4f2220da-1007-4ae8-9c12-73a142b02b49', None, None, None), ('a781604b-df59-4e97-af90-76111c0cda1e', None, None, None, None, None), ('a781604b-df59-4e97-af90-76111c0cda1e', None, None, None, None, None), ('81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83', '10.2.2.100', None, None, None, None), ('81b9af0d-e0ba-4df0-a8fb-85ccb3a13e83', '10.2.2.200', None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1259538714", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d9a27961-c537-4aa6-9fba-dbd50ba4d719"}, {"port": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac", "tag": "port-1"}, {"port": "94d3ede6-25a2-498c-8b67-412a4b84272c", "tag": "port-2"}, {"uuid": "67875982-ba72-46aa-9243-7ee6ad548426", "tag": "net-1"}, {"uuid": "67875982-ba72-46aa-9243-7ee6ad548426"}, {"uuid": "2fdcac75-feb4-4334-a416-431155705882", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2fdcac75-feb4-4334-a416-431155705882", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0127b28a-b328-4024-8edb-b43c5c24e0b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4c7aa8aa-2f09-46de-80ee-15a1f75cbe57", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--43379147"}], "key_name": "tempest-keypair-677934585", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:27 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] validate_networks() for [('d9a27961-c537-4aa6-9fba-dbd50ba4d719', None, None, None, None, None), (None, None, 'dd4aa184-e61f-4c14-bb1e-04e2b5c139ac', None, None, None), (None, None, '94d3ede6-25a2-498c-8b67-412a4b84272c', None, None, None), ('67875982-ba72-46aa-9243-7ee6ad548426', None, None, None, None, None), ('67875982-ba72-46aa-9243-7ee6ad548426', None, None, None, None, None), ('2fdcac75-feb4-4334-a416-431155705882', '10.2.2.100', None, None, None, None), ('2fdcac75-feb4-4334-a416-431155705882', '10.2.2.200', None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='982bf492-a432-431b-aa00-9cab35dd1b8a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-798798d8-9954-4b30-9fa8-e89cb25e0c5c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.798112 Apr 11 23:05:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 36/108] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:05:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f2c57067-b6d2-46ad-893f-aa915f02f4cc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-f2c57067-b6d2-46ad-893f-aa915f02f4cc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:27 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f2c57067-b6d2-46ad-893f-aa915f02f4cc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f2c57067-b6d2-46ad-893f-aa915f02f4cc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 200 len: 1052 microversion: 2.1 time: 0.079037 Apr 11 23:05:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:27 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 1052 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=19 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting quotas for project d2ea0b8c8a4b4a1cac18e97464975fab. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Getting quotas for user a6c3f5f97f8d4380a97913a14fda79df and project d2ea0b8c8a4b4a1cac18e97464975fab. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:29 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2f3d8fb7-2270-4c7c-b1ef-63cb207587dc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6fa2bf1e-d0db-4f0f-a5a2-e1152d427e7a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39261de4-8b4d-4e01-b027-628663c9a7fd',volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting quotas for project 4baaf4c6d66541b79d15d024804d934c. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Getting quotas for user 92d65920f60d4b0e811cf0bd7df65d35 and project 4baaf4c6d66541b79d15d024804d934c. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:05:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-15afbcea-a58c-481c-bf32-4f3ed321f8bf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.535598 Apr 11 23:05:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 35/110] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 23:05:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 3537 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:05:30 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:30 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f3c360cb-916b-4ce6-bd88-580edf091cf0 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 200 len: 1280 microversion: 2.42 time: 0.106343 Apr 11 23:05:30 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 38/111] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:05:30 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:05:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0127b28a-b328-4024-8edb-b43c5c24e0b3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6a9d5a05-97ac-49d7-92ce-cf2ed36a41a9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c7aa8aa-2f09-46de-80ee-15a1f75cbe57',volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:05:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0ea49871-d010-41a0-86bd-6d926b97c4d9 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.32 time: 3.983510 Apr 11 23:05:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 39/112] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 23:05:26 2023] POST /compute/v2.1/servers => generated 402 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:05:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:31 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:31 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:31 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b0fc6476-376e-4ad4-b042-c5dc8a54aee6 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 200 len: 1279 microversion: 2.32 time: 0.112367 Apr 11 23:05:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 36/113] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:05:30 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:32 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-afa1402d-4346-4f68-92bc-398b241ea9ac tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1492 microversion: 2.1 time: 0.309374 Apr 11 23:05:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:31 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1492 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] Creating event network-changed:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:05:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-dc48bec0-8e7f-42c9-83bb-8ee3de588987 req-1673f05f-dfe0-4e62-9831-e2b7ec53af42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037547 Apr 11 23:05:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:33 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-332db409-2031-46fd-9176-500945279ed7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1539 microversion: 2.1 time: 0.277448 Apr 11 23:05:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 37/116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:33 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1539 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:36 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-92e1141b-2b22-4d94-a9ed-04a259193e12 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1551 microversion: 2.1 time: 0.530710 Apr 11 23:05:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 40/117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:36 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1551 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:39 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:39 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:39 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] Creating event network-changed:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:39 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-dca5e10d-8cd5-4e00-a800-7f10d09fb7d9 req-309d42b6-498b-48f8-b89a-7b016699b13d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038524 Apr 11 23:05:39 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 41/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}, {"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660"}, {"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Creating event network-changed:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Creating event network-changed:9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] Creating event network-changed:dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b01c8508-da4f-4bbc-9b51-4bd009cd22bf req-e60d7ad1-e825-405d-9127-4376fb6ae74a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.048650 Apr 11 23:05:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=10 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=9 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=24 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:43 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-83022639-f2b5-4df8-a0f0-0f9697b7345d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1584 microversion: 2.20 time: 0.226709 Apr 11 23:05:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:05:43 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1584 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=11 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "94d3ede6-25a2-498c-8b67-412a4b84272c"}, {"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "4f2220da-1007-4ae8-9c12-73a142b02b49"}, {"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Creating event network-changed:94d3ede6-25a2-498c-8b67-412a4b84272c for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Creating event network-changed:4f2220da-1007-4ae8-9c12-73a142b02b49 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] Creating event network-changed:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-96e9185d-67b9-4a08-afd2-13656a760600 req-0650b95c-9654-4e5c-b8b7-ea36f82a3ee9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045753 Apr 11 23:05:43 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 42/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "name": "network-vif-plugged", "status": "completed", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] Creating event network-vif-plugged:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:05:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b2518d2f-2582-4963-b2ca-21b81d480fb0 req-c6d76997-3a60-4fe1-8f22-ce781c7bd64f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Apr 11 23:05:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 39/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:45 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}, {"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}, {"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Creating event network-changed:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Creating event network-changed:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] Creating event network-changed:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-18034b31-4a66-42dd-a387-e15717a29413 req-b5559c36-1241-421f-ac64-92686c3f8a02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.035989 Apr 11 23:05:45 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:45 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "name": "network-vif-plugged", "status": "completed", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] Creating event network-vif-plugged:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:05:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-908e0639-cef8-4009-bcd4-132bb713ea96 req-36e25f15-dd6f-40cb-a248-d157ed90de1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047353 Apr 11 23:05:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 43/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}, {"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Creating event network-changed:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Creating event network-changed:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] Creating event network-changed:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:05:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-48bd2cb3-915f-49fe-bef3-b8535c829b87 req-182cbfa9-d0d0-41ea-9142-a561f68d3597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.034842 Apr 11 23:05:48 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 40/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:47 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:05:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] Creating event network-changed:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:05:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-f20ec77c-af24-4ab8-a795-3819aab8055c req-05b390ee-19ad-4dc7-a602-9e3f02e68ed9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046443 Apr 11 23:05:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:05:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:51 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3f2619b8-c925-4d93-a119-c4501f6641eb tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" status: 200 len: 1545 microversion: 2.1 time: 0.440535 Apr 11 23:05:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 44/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:51 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => generated 1545 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:54 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9554290c1a944393b68875dbadee5e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204fa09429ce4f2fafbc532805a346bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c85db211-19be-4d77-b7f9-1aba84ce9ef3 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687" status: 200 len: 1526 microversion: 2.1 time: 0.192555 Apr 11 23:05:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 41/128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:54 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 => generated 1526 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:05:59 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4793e0b50343c3b0795159dbcbf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a01d410ba24128b6a884f317687a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:05:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-62d470f2-2ae4-45f0-9e8b-b66a2f1ac1db tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 200 len: 1550 microversion: 2.1 time: 0.156306 Apr 11 23:05:59 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:05:59 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=7 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=20 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] Creating event network-vif-plugged:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9e034369-236b-4e21-9fae-dab87745c7c7 req-474002ce-f8d2-4dba-aac2-a0cb35649f94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048516 Apr 11 23:06:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=20 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] Creating event network-vif-plugged:dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ff5b7e5d-4d5e-46db-bd5d-3f314373989e req-5f571e17-3900-4138-9c83-2f4f4dabff9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Apr 11 23:06:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 42/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:02 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bb41a40d-ca2d-453d-8205-3a68a6571995 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 200 len: 1628 microversion: 2.49 time: 0.240793 Apr 11 23:06:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 45/132] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:06:02 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 1628 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:06:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] Creating event network-vif-plugged:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5f9644f5-a97a-4b24-a6b4-eaa2c778e655 req-8c2d9ef2-5259-434a-afca-34ae4a4c3b05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 Apr 11 23:06:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:03 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "94d3ede6-25a2-498c-8b67-412a4b84272c"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "94d3ede6-25a2-498c-8b67-412a4b84272c"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:94d3ede6-25a2-498c-8b67-412a4b84272c for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:94d3ede6-25a2-498c-8b67-412a4b84272c for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] Creating event network-vif-plugged:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-917ac1ce-6c19-45b8-ae13-a7816a494b33 req-455ab2ea-01fb-4c19-be4d-e140d52815a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.047843 Apr 11 23:06:03 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "4f2220da-1007-4ae8-9c12-73a142b02b49"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] Creating event network-vif-plugged:4f2220da-1007-4ae8-9c12-73a142b02b49 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-187ae528-2c62-4994-98d6-3f544f3e3cdb req-10515a16-09da-4cbd-a6e8-460d8ef42795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.045804 Apr 11 23:06:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 23:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:05 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:05 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] Creating event network-vif-plugged:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e4a72402-764b-41c1-b859-dce2b47a4df4 req-8b337f86-06be-4a80-8527-a0bcb23a2e0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031777 Apr 11 23:06:05 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 47/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Creating event network-vif-plugged:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:06:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Creating event network-vif-plugged:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] Creating event network-vif-plugged:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-08398ffe-a819-4b3c-8ffa-6d51296b226c req-7dd46eae-85fc-4879-969d-405e08a70f88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042873 Apr 11 23:06:05 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "4f2220da-1007-4ae8-9c12-73a142b02b49"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] Creating event network-vif-plugged:4f2220da-1007-4ae8-9c12-73a142b02b49 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-182d8831-a6c9-411f-b607-0c7a6fbe4f0b req-46275e19-cc04-4212-99a9-05c4937b3511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032383 Apr 11 23:06:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] Creating event network-vif-plugged:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d8397eee-9634-454f-b407-a08d2abd6a55 req-1bbeda56-f8e5-4141-86ec-743843dd4ac1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051332 Apr 11 23:06:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] Creating event network-vif-plugged:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:06:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-d7931941-7e15-484e-a878-f60351868637 req-163fcb40-56f8-42c1-beda-19c4bd2807dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.060783 Apr 11 23:06:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=13 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=25 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:17 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-374a687c-84e8-4ca7-8e63-02ce51d6fc15 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 200 len: 1379 microversion: 2.1 time: 0.142977 Apr 11 23:06:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 48/141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:06:17 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 1379 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=7 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-1e1e3904-3217-4a3e-9835-3132d3700b36 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 200 len: 2820 microversion: 2.42 time: 0.268568 Apr 11 23:06:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 49/142] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:06:20 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 2820 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=15 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=7 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0a0f838d-e56a-4198-bebf-538ba96284b5 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 200 len: 2812 microversion: 2.32 time: 0.282305 Apr 11 23:06:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 46/143] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:06:21 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 2812 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1375177297", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] validate_networks() for [('02021ebc-33d0-4630-a873-2190cd8d8360', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting quotas for project 4c3e11fd040149dd8f5a130a9682a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Getting quotas for user 859ae6c19707455ebf82bf532c9e10c0 and project 4c3e11fd040149dd8f5a130a9682a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:06:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:06:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1fb40623-d938-42dc-9cc7-532d617291df tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.489792 Apr 11 23:06:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:06:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 23:06:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-48a0dc06-e106-43d0-a493-56a493cf48e6 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-48a0dc06-e106-43d0-a493-56a493cf48e6 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:32 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:32 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:32 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-48a0dc06-e106-43d0-a493-56a493cf48e6 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-48a0dc06-e106-43d0-a493-56a493cf48e6 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 200 len: 1211 microversion: 2.1 time: 0.065693 Apr 11 23:06:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 50/145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:06:32 2023] GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 1211 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:34 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f0ff4837-1dab-44e3-85ec-581597f3cf0a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.439082 Apr 11 23:06:34 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 47/146] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:06:33 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-interface => generated 282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] Creating event network-changed:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:06:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-a2507492-a586-417d-baab-db562a223d0a req-5be6da8b-f32e-436b-9893-f858efaed04c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030952 Apr 11 23:06:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:36 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-49125559-9742-44c1-85dc-cef218f1ddde tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1539 microversion: 2.1 time: 0.760747 Apr 11 23:06:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:06:36 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1539 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:37 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-31331e96-7009-47cf-ae28-358f730a5c6f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1539 microversion: 2.1 time: 0.188882 Apr 11 23:06:37 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:06:36 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-53d0f43d-b47a-4001-8752-e1d0e79bd349 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.129678 Apr 11 23:06:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 51/150] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:06:37 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-interface => generated 283 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] Creating event network-changed:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:06:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-8977e0a2-812c-4760-804c-217e679de6bb req-429f30fc-b7e8-4157-86d4-74a8fb1d490f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Apr 11 23:06:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 52/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] Creating event network-changed:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:06:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-157d4c36-f82b-4421-be8f-ec3d5d122d0a req-dc73b4cb-b1a1-415c-a8bb-e1bbe1d63209 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028920 Apr 11 23:06:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1684428574"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "name": "network-vif-plugged", "status": "completed", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] Creating event network-vif-plugged:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:06:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-941a22f0-b07a-4f2d-b17d-6a1b47c024f6 req-c2f3ee75-5f4d-421f-802b-4ef8e7c9e081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Apr 11 23:06:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 53/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3c0d230d-cd55-46dc-a6b0-3e63f3961237 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action" status: 202 len: 0 microversion: 2.1 time: 0.966613 Apr 11 23:06:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 52/154] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:06:38 2023] POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action => generated 0 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 23:06:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0f284e33-cef0-452d-a0c5-32759a7eeff0 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '.version_select at 0x7f3157d329e0>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0f284e33-cef0-452d-a0c5-32759a7eeff0 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a" status: 200 len: 1611 microversion: 2.1 time: 0.054585 Apr 11 23:06:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 50/155] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 23:06:39 2023] GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a => generated 1611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:06:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "name": "network-vif-plugged", "status": "completed", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:40 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] Creating event network-vif-plugged:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:06:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5d6941c2-0b08-429f-a6c1-70dcf355ffb1 req-af277acb-e4ac-45a3-b484-92759141b1f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040251 Apr 11 23:06:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 54/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c706b449-2ccb-4e82-9562-238de2dbe13d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.102566 Apr 11 23:06:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 53/157] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:06:43 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 23:06:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] Creating event network-changed:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:06:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-e7dfd53c-ef5d-4ade-b366-aabbe55f54a1 req-2a487dcb-068a-4bbd-9527-9abfb974f317 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038832 Apr 11 23:06:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 51/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-463dbd81-29c9-4223-98a1-c5ca73757ecd tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/ips" status: 200 len: 108 microversion: 2.20 time: 0.080718 Apr 11 23:06:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 55/159] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 23:06:44 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/ips => generated 108 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:06:45 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:45 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:46 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'flavor' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:06:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4e1a4eab-34e3-4637-83c5-914ca5dc8a87 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/action" status: 202 len: 0 microversion: 2.20 time: 0.829394 Apr 11 23:06:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 54/160] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:06:45 2023] POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:46 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:06:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-033756c0-0fad-4f1f-8a69-e827f2c15bfc tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1708 microversion: 2.20 time: 0.169863 Apr 11 23:06:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 52/161] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:06:46 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1708 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:06:47 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-unplugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] Creating event network-vif-unplugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:06:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-b8c6635d-4007-4749-a23d-b874e3143658 req-cece322c-d281-45a1-a202-d8474cda4ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032497 Apr 11 23:06:47 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 56/162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:49 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:06:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-8689424a-f1d5-4223-a90b-a4a3b495ddc4 req-8ef7e0ab-9654-40fa-9367-996081c9c9da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063931 Apr 11 23:06:49 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 55/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] Creating event network-changed:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-1413d691-48cd-47fd-bb89-711df59b484a req-2aff8343-3b6e-4d0c-9a83-92c5046572a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040581 Apr 11 23:06:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 53/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c5c5600e-9810-4e54-8a45-1de38b287e54 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105977 Apr 11 23:06:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 57/165] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:06:51 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] Creating event network-changed:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:06:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b193141c-9cbd-4eeb-a79b-2182a5acb318 req-00bf7a20-be1d-4c4f-b883-2e748b5c39ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035360 Apr 11 23:06:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93c2ce12-dbfc-4d27-8ef0-5021973204b3"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-127d60dc-a5f4-4d52-9a04-5c21edc0549e tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094951 Apr 11 23:06:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 58/167] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:06:54 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:55 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-718cb2e4-4173-4d9e-843f-d1b183ed6f70 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325915 Apr 11 23:06:55 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 54/168] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:06:54 2023] POST /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:55 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:55 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] Creating event network-changed:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:06:55 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-aaf8febb-29aa-40ac-b5f5-8517b887faf9 req-d0eb5467-43dc-40a4-a77f-31b5d25c2a75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035233 Apr 11 23:06:55 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5041ddaf-d487-479c-a3e7-a06d7bdae1a6"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-263130ae-28b3-4248-b0c6-275a93536b26 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402171 Apr 11 23:06:56 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 59/170] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:06:55 2023] POST /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:06:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:06:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-15ec373f-6a12-42b1-a056-000342a8ebf9 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108590 Apr 11 23:06:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 55/171] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:06:59 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-interface => generated 282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] Creating event network-changed:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:07:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-92b3dbaa-63c7-45f9-9ed2-49d8052428ee req-22f5b3ad-c14e-41ab-bdfa-46ddef006b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035423 Apr 11 23:07:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 58/172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f73aa597-317a-4488-8c76-1d2d243f9f6a"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-58a0d80d-dfcc-4344-b34a-f26cae274553 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.103804 Apr 11 23:07:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 56/173] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:07:02 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:07:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4bcf7c26-cc22-4240-b51f-5ae84cf547d4 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "POST /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283041 Apr 11 23:07:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 60/174] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:07:02 2023] POST /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1ad4ef9a-edeb-437e-bbbd-02ce138efc96"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:02 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] HTTP exception thrown: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Request method failure captured: Apr 11 23:07:03 user devstack@n-api.service[61859]: request: PUT /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments/93c2ce12-dbfc-4d27-8ef0-5021973204b3 HTTP/1.1 Apr 11 23:07:03 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:07:03 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:07:03 user devstack@n-api.service[61859]: Connection: close Apr 11 23:07:03 user devstack@n-api.service[61859]: Content-Length: 74 Apr 11 23:07:03 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:07:03 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:07:03 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:07:03 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeT1RwFbvTVmslP3UlGnwiieOVWabZ5osNNX3ClUpKLXetkw4ampajKe5bZM2HDbhc7HyVXWPm6WFaJCh5C4jXm3uVtZY4TDVqD7EgQRPb64FtBR_68QPHiYyuiMUTF95IDotbdVmlQfbjS_CjUhEwgQKdv8n8Lh3JGbL1XnPUgZHM Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Project-Id: 23f739656dd9476fb285a1c6796c1e89 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Role: member,reader,admin Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Roles: member,reader,admin Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23f739656dd9476fb285a1c6796c1e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23f739656dd9476fb285a1c6796c1e89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23f739656dd9476fb285a1c6796c1e89"}]}] Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Tenant-Id: 23f739656dd9476fb285a1c6796c1e89 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:07:03 user devstack@n-api.service[61859]: X-User: tempest-VolumesAdminNegativeTest-1100076750-project-admin Apr 11 23:07:03 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:07:03 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:07:03 user devstack@n-api.service[61859]: X-User-Id: ce1f5293b3e94b6fa1e38cd4b9c40d1a Apr 11 23:07:03 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesAdminNegativeTest-1100076750-project-admin Apr 11 23:07:03 user devstack@n-api.service[61859]: Apr 11 23:07:03 user devstack@n-api.service[61859]: {"volumeAttachment": {"volumeId": "1ad4ef9a-edeb-437e-bbbd-02ce138efc96"}} Apr 11 23:07:03 user devstack@n-api.service[61859]: method: > Apr 11 23:07:03 user devstack@n-api.service[61859]: exception: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. Apr 11 23:07:03 user devstack@n-api.service[61859]: action_args: {'server_id': 'fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3', 'id': '93c2ce12-dbfc-4d27-8ef0-5021973204b3', 'body': {'volumeAttachment': {'volumeId': '1ad4ef9a-edeb-437e-bbbd-02ce138efc96'}}} Apr 11 23:07:03 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. (HTTP 404) (Request-ID: req-c733aac9-b31b-4046-895f-be4c9a108a15) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. Apr 11 23:07:03 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Returning 400 to user: Volume 1ad4ef9a-edeb-437e-bbbd-02ce138efc96 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:07:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-cc5c8820-b13a-448b-942f-3f5d860e0dfc tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments/93c2ce12-dbfc-4d27-8ef0-5021973204b3" status: 400 len: 107 microversion: 2.1 time: 0.421988 Apr 11 23:07:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 23:07:02 2023] PUT /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments/93c2ce12-dbfc-4d27-8ef0-5021973204b3 => generated 107 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=25 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] Creating event network-changed:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-2d67ab4a-a61d-4aba-8a27-bd2e4e226d92 req-e89e28cd-9ab8-4ef6-a26f-5214056476c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040944 Apr 11 23:07:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 61/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lazy-loading 'services' on Instance uuid fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0ef72cdb-90f7-4eae-a6da-dbc136c2aacc tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 200 len: 1628 microversion: 2.49 time: 0.175991 Apr 11 23:07:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 60/177] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:03 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 1628 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "878270a4-e4b7-4b97-8a78-2db5a6493445", "tag": "nic-tag"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4988247b-c88b-4969-9463-43cc58dd276c tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments/93c2ce12-dbfc-4d27-8ef0-5021973204b3" status: 202 len: 0 microversion: 2.1 time: 0.300717 Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:03 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 57/178] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:07:03 2023] DELETE /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments/93c2ce12-dbfc-4d27-8ef0-5021973204b3 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9d3d8ba4-5568-43ae-b836-a7d6feafe96e tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 Apr 11 23:07:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 61/179] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:03 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "be9133e2-d785-4ec4-b4a1-843e8def60ba"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=21 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:03 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e582fd82-71f7-4b12-bfe1-db5192f4e79f tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/5041ddaf-d487-479c-a3e7-a06d7bdae1a6" status: 202 len: 0 microversion: 2.1 time: 0.455648 Apr 11 23:07:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 58/180] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 23:07:03 2023] PUT /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/5041ddaf-d487-479c-a3e7-a06d7bdae1a6 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:07:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] Creating event network-changed:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-dcc5d681-2567-467a-b81f-0cf4de01ed4b req-58b13206-5570-4466-afa4-ddd82edd0fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048543 Apr 11 23:07:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:06 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] Creating event network-vif-plugged:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-bbab73ea-9240-44a7-9643-eb7fdfaed8e1 req-f5bcbce5-a1af-4b2d-94cc-0d89cef8b392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055096 Apr 11 23:07:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 59/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0bb69f28-1ee6-4b29-af8a-4351e4fb9ff6 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.473969 Apr 11 23:07:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 62/183] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 23:07:03 2023] POST /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface => generated 282 bytes in 3477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2a6741f-6d85-4c26-8ff2-0dfefb4c6945", "tag": "volume-tag"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-110283b1-882c-4209-8e55-f8619f320b6b tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.360759 Apr 11 23:07:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 63/184] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 23:07:06 2023] POST /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:07:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] Creating event network-vif-plugged:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b2ca0dfb-a07e-4858-95c1-77e39fcfe7f8 req-90f701c1-ae2a-4c4b-8fe2-11e370f67d98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050291 Apr 11 23:07:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 60/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0ba1111b-d026-4c07-bcca-a323810162b3 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046161 Apr 11 23:07:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:09 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:09 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lazy-loading 'services' on Instance uuid 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:07:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-30cd0c79-7597-4d7f-abcd-fc638a3eea94 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments/f73aa597-317a-4488-8c76-1d2d243f9f6a" status: 202 len: 0 microversion: 2.1 time: 0.256048 Apr 11 23:07:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:07:09 2023] DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments/f73aa597-317a-4488-8c76-1d2d243f9f6a => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f1cdaf43-4991-4401-865a-213c913fb540 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090215 Apr 11 23:07:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 61/188] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:13 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3c82dcad-521a-40b9-a0fc-2283d82c4008 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088811 Apr 11 23:07:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 64/189] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:13 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:13 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:07:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7aeafe1c-d598-48ae-b862-23f7c85a602a tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 204 len: 0 microversion: 2.1 time: 0.275705 Apr 11 23:07:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:07:13 2023] DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4793e0b50343c3b0795159dbcbf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a01d410ba24128b6a884f317687a7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1985cb17-c473-4d32-b280-8606b7198193 tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 200 len: 1673 microversion: 2.1 time: 0.319589 Apr 11 23:07:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:14 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 1673 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:07:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "name": "network-vif-unplugged", "status": "completed", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] Creating event network-vif-unplugged:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:07:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ce77c0e8-5409-418c-afda-08f313d2d548 req-5aea4dfd-6725-4f59-a181-a658b0480bf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062476 Apr 11 23:07:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 65/192] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:16 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "name": "network-vif-plugged", "status": "completed", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}, {"server_uuid": "041d3e65-4e73-4416-8f0a-b2ff6dca3e77", "name": "network-vif-deleted", "tag": "a115300b-147f-450e-a3f8-94d5f0b70a06"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Creating event network-vif-plugged:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:07:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] Creating event network-vif-deleted:a115300b-147f-450e-a3f8-94d5f0b70a06 for instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 on user Apr 11 23:07:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-e7119c40-84a9-43be-8dd4-ef521c077373 req-e9d8c1eb-b95e-4ce7-ac7a-8d496503ecfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030825 Apr 11 23:07:16 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 63/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:16 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lazy-loading 'services' on Instance uuid 902899b9-8c8f-404e-a110-832b3c91d526 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:07:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-78206eba-fe59-48e9-8458-6e63063f8c20 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments/f2a6741f-6d85-4c26-8ff2-0dfefb4c6945" status: 202 len: 0 microversion: 2.49 time: 0.172618 Apr 11 23:07:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 23:07:16 2023] DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments/f2a6741f-6d85-4c26-8ff2-0dfefb4c6945 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e1cf0c6d-ee43-486f-92cd-eb213284124d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060594 Apr 11 23:07:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:17 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-90d8d5d9-8e55-451e-b921-1545b9eb22d0 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058251 Apr 11 23:07:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:17 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5041ddaf-d487-479c-a3e7-a06d7bdae1a6"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-13636c46-2901-46c2-a95d-f98fd3519bca tempest-TestVolumeSwap-433787519 tempest-TestVolumeSwap-433787519-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/be9133e2-d785-4ec4-b4a1-843e8def60ba" status: 202 len: 0 microversion: 2.1 time: 0.325609 Apr 11 23:07:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 67/197] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 23:07:17 2023] PUT /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/be9133e2-d785-4ec4-b4a1-843e8def60ba => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0ae481a6-7a8e-4ab1-9e09-6878165d256a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 200 len: 1379 microversion: 2.1 time: 0.161465 Apr 11 23:07:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:17 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 1379 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c67f4cbb-3b8a-4f0f-8357-907c901874f5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 200 len: 1379 microversion: 2.1 time: 0.191664 Apr 11 23:07:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:18 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 1379 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:07:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-36264939-779c-413f-ae2d-621c1003f592 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 204 len: 0 microversion: 2.1 time: 0.129717 Apr 11 23:07:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 68/200] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:07:18 2023] DELETE /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-de196825-e6f5-4a0a-aed3-93502ec7f202 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 200 len: 1385 microversion: 2.1 time: 0.173295 Apr 11 23:07:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:18 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 1385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "name": "network-vif-unplugged", "status": "completed", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] Creating event network-vif-unplugged:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:07:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-50905e37-d553-4423-9225-78f6e39dbbb4 req-732e278f-e43e-4495-be39-ef2e91f68424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032495 Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 66/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:18 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c38c4676-8c72-4855-8335-0a7828bd49d1 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface/85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230" status: 202 len: 0 microversion: 2.49 time: 0.060763 Apr 11 23:07:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 69/203] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 23:07:18 2023] DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-interface/85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4e1b8f66-9879-4a71-966f-5a4058d80ded tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1" status: 200 len: 474 microversion: 2.49 time: 0.237688 Apr 11 23:07:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 23:07:18 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1 => generated 474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:07:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-deleted", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] Creating event network-vif-deleted:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-eb233e5e-6cd0-454f-841e-17b1661b2b1c req-e1a65458-4bb8-4002-a58d-25585b460fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040972 Apr 11 23:07:19 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 67/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "name": "network-vif-plugged", "status": "completed", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}, {"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-unplugged", "status": "completed", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}, {"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Creating event network-vif-plugged:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:07:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Creating event network-vif-unplugged:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] Creating event network-vif-plugged:85d9a5fe-ae77-4c8c-bd6e-ee6718e8c230 for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:07:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-af4d7296-b17e-410b-b447-e3273bf095d3 req-7add0dfb-06b2-48c7-a2ac-5b4626f16bd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.043034 Apr 11 23:07:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 70/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-30dd5745-4a5f-4c77-91c7-ec2b7109fd22 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598/os-interface" status: 200 len: 1825 microversion: 2.42 time: 0.162832 Apr 11 23:07:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 70/207] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:07:20 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598/os-interface => generated 1825 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6254f027-a901-4a22-a1fc-3b85a62e9886 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.194615 Apr 11 23:07:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 68/208] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:07:21 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7/os-interface => generated 1828 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79fcca6-9f11-498f-b580-5681f9589a77", "name": "network-vif-deleted", "tag": "1c726827-fb42-4618-ac03-9051705301a0"}, {"name": "network-changed", "server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Creating event network-vif-deleted:1c726827-fb42-4618-ac03-9051705301a0 for instance f79fcca6-9f11-498f-b580-5681f9589a77 on user Apr 11 23:07:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] Creating event network-changed:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-920bbd07-0204-460f-b558-db6e2e218772 req-f7c064a7-e689-46fb-8917-2c538deeb8e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047939 Apr 11 23:07:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 71/209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-731e099b-a6d7-4de7-91a6-f59f6b0ced26 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 200 len: 2820 microversion: 2.42 time: 0.441318 Apr 11 23:07:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 71/210] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:21 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 2820 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-139ec9c4-d7e9-4b7c-b29e-23f6b807fddd tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598/os-interface" status: 200 len: 1825 microversion: 2.42 time: 0.151553 Apr 11 23:07:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 69/211] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:07:22 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598/os-interface => generated 1825 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0a1396a3-a999-4ddf-ad35-6cd88b4ad615 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 200 len: 1492 microversion: 2.1 time: 0.317474 Apr 11 23:07:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:22 2023] GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 1492 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-79abb81c-d8af-4046-8c0e-36131e6e82db tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 200 len: 2812 microversion: 2.32 time: 0.321477 Apr 11 23:07:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 72/213] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:23 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 2812 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b9c73ebb-277c-4192-b627-f50b0494fcf4 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.172473 Apr 11 23:07:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 70/214] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:07:23 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7/os-interface => generated 1828 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:07:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fe32eb93-eace-4fe6-8016-f5f7320157fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 204 len: 0 microversion: 2.42 time: 0.147935 Apr 11 23:07:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 73/215] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:07:23 2023] DELETE /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] Creating event network-changed:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ec15adaa-6cbc-4d45-a9fb-3f0c0f23cec4 req-2001e527-577f-46d8-9466-07443eec7858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Apr 11 23:07:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 71/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c3f5f97f8d4380a97913a14fda79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ea0b8c8a4b4a1cac18e97464975fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f90cb629-3f5b-4f76-be9f-904bd6ce90c4 tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 200 len: 2943 microversion: 2.42 time: 0.335042 Apr 11 23:07:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 73/217] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:23 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 2943 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:24 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] Creating event network-vif-unplugged:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-719035aa-c370-4c0c-b599-7ad3e9e550ad req-17be6c10-fd04-4e1f-9569-3a9df6275ee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042942 Apr 11 23:07:24 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 74/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] Creating event network-vif-unplugged:9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-558a0113-9b58-44b7-a9f5-7fc790cc1b4f req-d78790a2-97d1-465e-a4f9-e2d7b2c4df16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045467 Apr 11 23:07:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 72/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:24 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:07:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-10f95d32-61d4-4ed3-8296-14002b21bb37 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 204 len: 0 microversion: 2.32 time: 0.338654 Apr 11 23:07:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 74/220] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:07:24 2023] DELETE /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92d65920f60d4b0e811cf0bd7df65d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4baaf4c6d66541b79d15d024804d934c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-11e7b36d-84b8-4e62-8fe2-f56fb24fe0f0 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 200 len: 2818 microversion: 2.32 time: 0.566533 Apr 11 23:07:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 75/221] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:25 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 2818 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] Creating event network-vif-unplugged:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-bac12093-1793-4547-8fb6-627879ffb839 req-7501a951-c19a-4b2a-979a-280039fb4720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075830 Apr 11 23:07:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 73/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Creating event network-vif-plugged:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Creating event network-vif-unplugged:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Creating event network-vif-plugged:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Creating event network-vif-unplugged:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] Creating event network-vif-plugged:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-f48cb820-1bd5-4a76-91a4-a3c7fdd6c91b req-85cab3f5-6d6b-402a-80bd-c7885ba3390b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.123065 Apr 11 23:07:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "4f2220da-1007-4ae8-9c12-73a142b02b49"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "4f2220da-1007-4ae8-9c12-73a142b02b49"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Creating event network-vif-plugged:9486eb92-5cb7-4c1e-9bfb-ca8bd2d14660 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Creating event network-vif-unplugged:4f2220da-1007-4ae8-9c12-73a142b02b49 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Creating event network-vif-plugged:4f2220da-1007-4ae8-9c12-73a142b02b49 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Creating event network-vif-unplugged:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] Creating event network-vif-plugged:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-bea5ff16-ff33-4ff8-9a0c-4988e3246c1c req-b0f4ff82-caeb-4175-92fd-65d008279fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.080947 Apr 11 23:07:26 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:27 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fadf55a8-3167-4004-8375-d2b5266fb894 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1658 microversion: 2.1 time: 0.355840 Apr 11 23:07:27 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 74/225] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:27 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1658 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:27 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-be38106f-2820-4ddd-9287-3aec4c95867d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1658 microversion: 2.1 time: 0.263824 Apr 11 23:07:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:27 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1658 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:28 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] Creating event network-vif-plugged:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-dcfc8521-bc5a-4958-81e1-7f6d9153c678 req-d22509a4-62c2-480e-8755-b49baf69bd0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037467 Apr 11 23:07:28 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 77/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:28 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-unplugged", "status": "completed", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-plugged", "status": "completed", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dd4aa184-e61f-4c14-bb1e-04e2b5c139ac"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "94d3ede6-25a2-498c-8b67-412a4b84272c"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "94d3ede6-25a2-498c-8b67-412a4b84272c"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-unplugged:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-plugged:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-unplugged:dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-plugged:dd4aa184-e61f-4c14-bb1e-04e2b5c139ac for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-unplugged:94d3ede6-25a2-498c-8b67-412a4b84272c for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-plugged:94d3ede6-25a2-498c-8b67-412a4b84272c for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-unplugged:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-plugged:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] Creating event network-vif-unplugged:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ad9c3100-91ee-48e3-878f-bdefc8cba788 req-26b355c8-e327-4650-8102-a22db83609fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1561 microversion: 2.1 time: 0.048571 Apr 11 23:07:28 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 75/228] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 23:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 1561 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Creating event network-vif-unplugged:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Creating event network-vif-plugged:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Creating event network-vif-unplugged:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] Creating event network-vif-plugged:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3969d27e-acfc-41cb-b52a-11efce1fd114 req-7a0aa322-4ecf-4584-bb18-1b8143acc0a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.035899 Apr 11 23:07:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a0b31aab-8981-4801-b4e0-9d710db61473 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '.version_select at 0x7f3157cecee0>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a0b31aab-8981-4801-b4e0-9d710db61473 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a" status: 200 len: 1725 microversion: 2.1 time: 0.057841 Apr 11 23:07:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 23:07:29 2023] GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a => generated 1725 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:29 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-dd38d820-abca-4c63-bae0-e181d34c0688 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '.version_select at 0x7f3157a35c60>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:29 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-dd38d820-abca-4c63-bae0-e181d34c0688 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a" status: 200 len: 1725 microversion: 2.1 time: 0.053687 Apr 11 23:07:29 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 76/231] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 23:07:29 2023] GET /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a => generated 1725 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:29 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:29 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-08ce02d0-581c-42d7-8dbd-b6334bfdfd1c tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1670 microversion: 2.1 time: 0.154721 Apr 11 23:07:29 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:29 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:30 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-plugged", "status": "completed", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] Creating event network-vif-plugged:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-4391ac96-665f-4e13-bd6b-ab4b4fea448a req-f776c278-3575-4c90-a03a-d6e1e6feb263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035085 Apr 11 23:07:30 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 79/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-2d71e481-cfb8-443d-9e97-806974b9a062 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Apr 11 23:07:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 77/234] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:30 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-817f1d40-8802-4530-a5bd-199645a296dd tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053317 Apr 11 23:07:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:30 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:31 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lazy-loading 'services' on Instance uuid 5d6517f0-c4f0-4b35-a94a-610058ecc687 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:07:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7ac83dad-c660-44e7-ae90-611232ffbeb4 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/5041ddaf-d487-479c-a3e7-a06d7bdae1a6" status: 202 len: 0 microversion: 2.1 time: 0.195700 Apr 11 23:07:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:07:31 2023] DELETE /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments/5041ddaf-d487-479c-a3e7-a06d7bdae1a6 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-19e3bcbc-44e3-4a2e-a0b2-7870e7926565 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054891 Apr 11 23:07:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 78/237] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:31 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:07:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-deleted", "tag": "53ff16a9-5f97-4d83-9b59-7ce5c337f392"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:34 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] Creating event network-vif-deleted:53ff16a9-5f97-4d83-9b59-7ce5c337f392 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3121149e-0ead-4ec7-bdce-e34fda782837 req-66bced37-17da-47bb-b6ff-41a56192e5e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031313 Apr 11 23:07:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-deleted", "tag": "5469ebfb-ee6b-49b3-9ae9-35423e6254a1"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-deleted", "tag": "5296123e-0b05-4e29-b252-6e2db7395f78"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-deleted", "tag": "0dc3835d-017b-4411-a70a-c538768a13b7"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-deleted", "tag": "86246915-cf00-43be-b433-01b4ed88252c"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-deleted", "tag": "7f3e80ab-f7c2-4300-a599-eed29afc0e83"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-deleted", "tag": "d29edb78-cc5a-4e48-81af-a915190376af"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:5469ebfb-ee6b-49b3-9ae9-35423e6254a1 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:5296123e-0b05-4e29-b252-6e2db7395f78 for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:0dc3835d-017b-4411-a70a-c538768a13b7 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:86246915-cf00-43be-b433-01b4ed88252c for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:7f3e80ab-f7c2-4300-a599-eed29afc0e83 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] Creating event network-vif-deleted:d29edb78-cc5a-4e48-81af-a915190376af for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-cbc1cbcb-7b1e-4ce8-a72b-fc93f071d25d req-53bb9b5e-cf88-42e9-8640-aae99c78792f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.043279 Apr 11 23:07:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 81/239] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:36 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=40 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:37 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b45118b8-0e53-4cb0-a254-11ec2dcb134d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1649 microversion: 2.20 time: 0.179344 Apr 11 23:07:37 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 79/240] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:07:37 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1649 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:07:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-deleted", "tag": "ba2be13d-a019-4ba5-8b60-ed888cf7699e"}, {"server_uuid": "89644573-5fbc-4ab4-a16b-23b7c4f6c598", "name": "network-vif-deleted", "tag": "39a39a5d-8b30-4e73-893d-323dbde1de9f"}, {"server_uuid": "f59cffaa-b1e0-427d-b395-1043bad9a5c7", "name": "network-vif-deleted", "tag": "dc64ce92-4113-4d3c-85fd-46ac2058a479"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Creating event network-vif-deleted:ba2be13d-a019-4ba5-8b60-ed888cf7699e for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Creating event network-vif-deleted:39a39a5d-8b30-4e73-893d-323dbde1de9f for instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 on user Apr 11 23:07:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] Creating event network-vif-deleted:dc64ce92-4113-4d3c-85fd-46ac2058a479 for instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 on user Apr 11 23:07:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-452b405f-6196-4c6b-9679-7c8a37566204 req-2b8c99b7-885a-49a5-9153-339e52537d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033494 Apr 11 23:07:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-364fd084-9f63-4904-aa33-a1adbc2c923f tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049979 Apr 11 23:07:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:07:53 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:07:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-377335540", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "0678e3e7-49ce-4482-b828-84fd3ed1cf15"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=5 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:53 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] validate_networks() for [('0678e3e7-49ce-4482-b828-84fd3ed1cf15', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for project c24d77b00c084f6f857147717350b6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Getting quotas for user 340848f1de07428e85af2cf660943c3e and project c24d77b00c084f6f857147717350b6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:07:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:07:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fd178d55-98a1-4375-8fa5-16b01c9ab33b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.643324 Apr 11 23:07:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 80/243] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:07:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:07:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=15 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:07:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2a8a041f-d46b-42a0-9ad3-e5b44b9bd006 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:07:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-2a8a041f-d46b-42a0-9ad3-e5b44b9bd006 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:07:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-2a8a041f-d46b-42a0-9ad3-e5b44b9bd006 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:07:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2a8a041f-d46b-42a0-9ad3-e5b44b9bd006 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb" status: 200 len: 1211 microversion: 2.1 time: 0.079783 Apr 11 23:07:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:07:54 2023] GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:07:56 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:56 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] Creating event network-changed:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:07:56 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-43bad0ea-0494-46d6-93d6-ba298489b706 req-84124ffb-15f5-419b-92cf-0e0a3f4cb60a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034737 Apr 11 23:07:56 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:07:58 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "name": "network-vif-plugged", "status": "completed", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:07:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:07:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:07:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:07:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] Creating event network-vif-plugged:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:07:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ed0fc825-e28e-448c-be12-660f8897ff89 req-8889676a-6bac-4d18-aaf1-2d19b758be2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Apr 11 23:07:58 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 81/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "name": "network-vif-plugged", "status": "completed", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] Creating event network-vif-plugged:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:08:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-2eed6297-c661-4f0f-be1a-0939becfa400 req-7c401ef1-6bab-4a50-bc87-f36054889c0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Apr 11 23:08:00 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] HTTP exception thrown: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Request method failure captured: Apr 11 23:08:04 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 HTTP/1.1 Apr 11 23:08:04 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:08:04 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:08:04 user devstack@n-api.service[61859]: Connection: close Apr 11 23:08:04 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:08:04 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:08:04 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:08:04 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:08:04 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeFszsm9h3iEVFXEioF2SH8CF23YMFaKA93AMKMOfua8e2a22iYs97QgvaFpwYNtC53LKPOsNJSscW415xZylKIYrjweUk6on7lPK1GMc4SOA_0s5Q3C03TWTQM0KdO4ePpa3vqtcDUKk2ijvEoTmgxcWEGZDOefFOb-2pwsYfwKEs Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Project-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13a01d410ba24128b6a884f317687a7d"}]}] Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Tenant-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:04 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:04 user devstack@n-api.service[61859]: X-User: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:04 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:08:04 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:08:04 user devstack@n-api.service[61859]: X-User-Id: fe4793e0b50343c3b0795159dbcbf46b Apr 11 23:08:04 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:04 user devstack@n-api.service[61859]: method: > Apr 11 23:08:04 user devstack@n-api.service[61859]: exception: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:04 user devstack@n-api.service[61859]: action_args: {'id': '041d3e65-4e73-4416-8f0a-b2ff6dca3e77'} Apr 11 23:08:04 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Returning 404 to user: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c60e03ca-cdf9-46fe-a6a5-afd336a40dfe tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 404 len: 111 microversion: 2.1 time: 0.034836 Apr 11 23:08:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 84/248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:04 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:04 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:04 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b30f29c6-1cb5-49da-851f-27027248b15f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '.version_select at 0x7f3157ceae60>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b30f29c6-1cb5-49da-851f-27027248b15f tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505121934" status: 202 len: 0 microversion: 2.1 time: 0.028644 Apr 11 23:08:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:08:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505121934 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] HTTP exception thrown: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Request method failure captured: Apr 11 23:08:07 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 HTTP/1.1 Apr 11 23:08:07 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:08:07 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:08:07 user devstack@n-api.service[61861]: Connection: close Apr 11 23:08:07 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:08:07 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:08:07 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:08:07 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:08:07 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeeFszsm9h3iEVFXEioF2SH8CF23YMFaKA93AMKMOfua8e2a22iYs97QgvaFpwYNtC53LKPOsNJSscW415xZylKIYrjweUk6on7lPK1GMc4SOA_0s5Q3C03TWTQM0KdO4ePpa3vqtcDUKk2ijvEoTmgxcWEGZDOefFOb-2pwsYfwKEs Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Project-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13a01d410ba24128b6a884f317687a7d"}]}] Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Tenant-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:07 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61861]: X-User: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:07 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:08:07 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:08:07 user devstack@n-api.service[61861]: X-User-Id: fe4793e0b50343c3b0795159dbcbf46b Apr 11 23:08:07 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:07 user devstack@n-api.service[61861]: method: > Apr 11 23:08:07 user devstack@n-api.service[61861]: exception: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61861]: action_args: {'id': '041d3e65-4e73-4416-8f0a-b2ff6dca3e77'} Apr 11 23:08:07 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Returning 404 to user: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-eddafaa6-3fed-4371-bb99-3b3283fc715e tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 404 len: 111 microversion: 2.1 time: 0.033931 Apr 11 23:08:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:08:07 2023] DELETE /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] [instance: 041d3e65-4e73-4416-8f0a-b2ff6dca3e77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] HTTP exception thrown: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Request method failure captured: Apr 11 23:08:07 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 HTTP/1.1 Apr 11 23:08:07 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:08:07 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:08:07 user devstack@n-api.service[61859]: Connection: close Apr 11 23:08:07 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:08:07 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:08:07 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:08:07 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:08:07 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeFszsm9h3iEVFXEioF2SH8CF23YMFaKA93AMKMOfua8e2a22iYs97QgvaFpwYNtC53LKPOsNJSscW415xZylKIYrjweUk6on7lPK1GMc4SOA_0s5Q3C03TWTQM0KdO4ePpa3vqtcDUKk2ijvEoTmgxcWEGZDOefFOb-2pwsYfwKEs Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Project-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13a01d410ba24128b6a884f317687a7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13a01d410ba24128b6a884f317687a7d"}]}] Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Tenant-Id: 13a01d410ba24128b6a884f317687a7d Apr 11 23:08:07 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004545832 Apr 11 23:08:07 user devstack@n-api.service[61859]: X-User: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:07 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:08:07 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:08:07 user devstack@n-api.service[61859]: X-User-Id: fe4793e0b50343c3b0795159dbcbf46b Apr 11 23:08:07 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004545832-project-member Apr 11 23:08:07 user devstack@n-api.service[61859]: method: > Apr 11 23:08:07 user devstack@n-api.service[61859]: exception: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61859]: action_args: {'id': '041d3e65-4e73-4416-8f0a-b2ff6dca3e77'} Apr 11 23:08:07 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. Apr 11 23:08:07 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] Returning 404 to user: Instance 041d3e65-4e73-4416-8f0a-b2ff6dca3e77 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-425df9fc-0930-4760-8481-aa360bde96fb tempest-AttachSCSIVolumeTestJSON-2004545832 tempest-AttachSCSIVolumeTestJSON-2004545832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77" status: 404 len: 111 microversion: 2.1 time: 0.027668 Apr 11 23:08:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 85/251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:07 2023] GET /compute/v2.1/servers/041d3e65-4e73-4416-8f0a-b2ff6dca3e77 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:08:08 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 HTTP/1.1 Apr 11 23:08:08 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:08:08 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:08:08 user devstack@n-api.service[61860]: Connection: close Apr 11 23:08:08 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:08:08 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:08:08 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:08:08 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:08:08 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61860]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:08:08 user devstack@n-api.service[61860]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61860]: method: > Apr 11 23:08:08 user devstack@n-api.service[61860]: exception: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61860]: action_args: {'id': 'f79fcca6-9f11-498f-b580-5681f9589a77'} Apr 11 23:08:08 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1c18fa66-9c23-4929-bacf-808df256bbcb tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 404 len: 111 microversion: 2.1 time: 0.035917 Apr 11 23:08:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:08 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:08:08 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 HTTP/1.1 Apr 11 23:08:08 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:08:08 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:08:08 user devstack@n-api.service[61861]: Connection: close Apr 11 23:08:08 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:08:08 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:08:08 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:08:08 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:08:08 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61861]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:08:08 user devstack@n-api.service[61861]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61861]: method: > Apr 11 23:08:08 user devstack@n-api.service[61861]: exception: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61861]: action_args: {'id': 'f79fcca6-9f11-498f-b580-5681f9589a77'} Apr 11 23:08:08 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e03ce604-259c-40fc-a264-4d484c74a6ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 404 len: 111 microversion: 2.1 time: 0.029375 Apr 11 23:08:08 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:08:08 2023] DELETE /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f79fcca6-9f11-498f-b580-5681f9589a77] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:08 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:08:08 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 HTTP/1.1 Apr 11 23:08:08 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:08:08 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:08:08 user devstack@n-api.service[61859]: Connection: close Apr 11 23:08:08 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:08:08 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:08:08 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:08:08 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:08:08 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:08:08 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:08:08 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:08:08 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:08:08 user devstack@n-api.service[61859]: method: > Apr 11 23:08:08 user devstack@n-api.service[61859]: exception: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61859]: action_args: {'id': 'f79fcca6-9f11-498f-b580-5681f9589a77'} Apr 11 23:08:08 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. Apr 11 23:08:08 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance f79fcca6-9f11-498f-b580-5681f9589a77 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:08 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-52b05b95-a591-4b0f-aebc-ece9edb5389e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77" status: 404 len: 111 microversion: 2.1 time: 0.031283 Apr 11 23:08:08 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:08 2023] GET /compute/v2.1/servers/f79fcca6-9f11-498f-b580-5681f9589a77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-48e676b1-5f2d-4327-9405-6095560aa3a3 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1" status: 200 len: 503 microversion: 2.49 time: 0.090984 Apr 11 23:08:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 84/255] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 23:08:09 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1 => generated 503 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6c0b7d1b-aaaa-4db4-b16c-b7ffa356e329 tempest-TaggedAttachmentsTest-1289574494 tempest-TaggedAttachmentsTest-1289574494-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1" status: 200 len: 503 microversion: 2.49 time: 0.043195 Apr 11 23:08:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 23:08:09 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-instance-actions/req-c38c4676-8c72-4855-8335-0a7828bd49d1 => generated 503 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4827a1a0-d01e-43d8-8bec-044ecaa2fc70 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.044102 Apr 11 23:08:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 87/257] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 23:08:09 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:08:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-592f307f-23c2-4026-bf9d-f07a97d38020 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 204 len: 0 microversion: 2.49 time: 0.126271 Apr 11 23:08:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 85/258] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:08:09 2023] DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:09 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343064f07762476ca5221be36dcbd0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fb372296e5430e9f915be720934494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-080204b6-1fe7-45d8-b92c-51ea6e8e18a3 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 200 len: 1753 microversion: 2.49 time: 0.232186 Apr 11 23:08:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:09 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 1753 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-unplugged", "status": "completed", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] Creating event network-vif-unplugged:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:08:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-a7e340b1-04aa-4431-a904-afb4cb5cacdd req-c88849dd-ce0d-4469-9099-62b18ab56ef6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036968 Apr 11 23:08:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-plugged", "status": "completed", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}, {"server_uuid": "902899b9-8c8f-404e-a110-832b3c91d526", "name": "network-vif-deleted", "tag": "ce46605b-463c-483c-9887-8923c6b74bbd"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Creating event network-vif-plugged:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:08:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] Creating event network-vif-deleted:ce46605b-463c-483c-9887-8923c6b74bbd for instance 902899b9-8c8f-404e-a110-832b3c91d526 on user Apr 11 23:08:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-7b1552ed-2702-4843-9a91-26eba720a1de req-1ceadf2a-a827-431b-b5a7-6b526b8b46f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031204 Apr 11 23:08:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 86/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-205162088", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "1f79365f-d1d4-4c01-94f3-205e20bec9d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HTTP exception thrown: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Request method failure captured: Apr 11 23:08:14 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 HTTP/1.1 Apr 11 23:08:14 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:08:14 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:08:14 user devstack@n-api.service[61859]: Connection: close Apr 11 23:08:14 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:08:14 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:08:14 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:08:14 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:08:14 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNed0QW8-M25mGB3KL_izwZnq3UNSneWviTs5Lb6WueSLd0G9cFyC2llECu_odGDkcDvV8rifK2uYGzrKQu9wv5R1YmmfnmbISg2yDRjZyR4piyXKv9A-dOD3yadeHsRGxkSgZjPDcKuDn3Ljop26BzJYAitLzE1B7ZY7f8Nx8I7YJkE Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Project-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2ea0b8c8a4b4a1cac18e97464975fab"}]}] Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Tenant: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Tenant-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:14 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:14 user devstack@n-api.service[61859]: X-User: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:14 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:08:14 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:08:14 user devstack@n-api.service[61859]: X-User-Id: a6c3f5f97f8d4380a97913a14fda79df Apr 11 23:08:14 user devstack@n-api.service[61859]: X-User-Name: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:14 user devstack@n-api.service[61859]: method: > Apr 11 23:08:14 user devstack@n-api.service[61859]: exception: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:14 user devstack@n-api.service[61859]: action_args: {'id': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'} Apr 11 23:08:14 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Returning 404 to user: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d6a763dd-a5b7-4837-9a9f-b1ad0b3196fb tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 404 len: 111 microversion: 2.42 time: 0.028530 Apr 11 23:08:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 89/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:14 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-998c66f3-a3d1-4611-a27a-cc440629193d tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '.version_select at 0x7f3157998550>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-998c66f3-a3d1-4611-a27a-cc440629193d tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302009898" status: 204 len: 0 microversion: 2.42 time: 0.023190 Apr 11 23:08:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 87/263] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 23:08:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302009898 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:08:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f79365f-d1d4-4c01-94f3-205e20bec9d5',volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:08:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9ff27ba4-6160-40c1-b668-626b1eabe85c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.637170 Apr 11 23:08:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 88/264] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:08:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d22b2ce4-2c4b-499b-9fb1-84301b333358 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d22b2ce4-2c4b-499b-9fb1-84301b333358 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:14 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-d22b2ce4-2c4b-499b-9fb1-84301b333358 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d22b2ce4-2c4b-499b-9fb1-84301b333358 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 200 len: 1065 microversion: 2.1 time: 0.087774 Apr 11 23:08:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 90/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:14 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 1065 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HTTP exception thrown: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Request method failure captured: Apr 11 23:08:15 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 HTTP/1.1 Apr 11 23:08:15 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:08:15 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:08:15 user devstack@n-api.service[61860]: Connection: close Apr 11 23:08:15 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:08:15 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:08:15 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:08:15 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:08:15 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeCgOBVuvGgk4arA9WBnhm8QWpvFGxOrqVhjWsngnOF2eobuqutPMVd60btJ59G32CckDrxP2GIGCH1T0XkFf8KMPzTxIF4EpLoy2rtEQnNTDjV7o48ensPJutZc5rqFGYaA3sXQzI1u9rj-OQAxBTNjyRwXAuNOTtwaTK7xMXeldE Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Project-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Project-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4baaf4c6d66541b79d15d024804d934c"}]}] Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Tenant: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Tenant-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:15 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-User: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:15 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:08:15 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:08:15 user devstack@n-api.service[61860]: X-User-Id: 92d65920f60d4b0e811cf0bd7df65d35 Apr 11 23:08:15 user devstack@n-api.service[61860]: X-User-Name: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:15 user devstack@n-api.service[61860]: method: > Apr 11 23:08:15 user devstack@n-api.service[61860]: exception: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:15 user devstack@n-api.service[61860]: action_args: {'id': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'} Apr 11 23:08:15 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Returning 404 to user: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-623039c2-3ed8-4cee-8ce6-ff974458a872 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 404 len: 111 microversion: 2.32 time: 0.041221 Apr 11 23:08:15 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 88/266] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:15 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bb2cf0db-149e-434f-92e9-5864caaf5010 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '.version_select at 0x7f3157aa67a0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bb2cf0db-149e-434f-92e9-5864caaf5010 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677934585" status: 204 len: 0 microversion: 2.32 time: 0.027985 Apr 11 23:08:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 89/267] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 23:08:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677934585 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:08:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] Creating event network-changed:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:08:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-eb0fc08c-00ae-40bc-a1bf-2939a42302fa req-c1becbf2-05a2-44c0-b78f-056ad1363540 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Apr 11 23:08:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 91/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:08:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HTTP exception thrown: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Request method failure captured: Apr 11 23:08:18 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 HTTP/1.1 Apr 11 23:08:18 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:08:18 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:08:18 user devstack@n-api.service[61860]: Connection: close Apr 11 23:08:18 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:08:18 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:08:18 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:08:18 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:08:18 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed0QW8-M25mGB3KL_izwZnq3UNSneWviTs5Lb6WueSLd0G9cFyC2llECu_odGDkcDvV8rifK2uYGzrKQu9wv5R1YmmfnmbISg2yDRjZyR4piyXKv9A-dOD3yadeHsRGxkSgZjPDcKuDn3Ljop26BzJYAitLzE1B7ZY7f8Nx8I7YJkE Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Project-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2ea0b8c8a4b4a1cac18e97464975fab"}]}] Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Tenant: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Tenant-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:18 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61860]: X-User: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:18 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:08:18 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:08:18 user devstack@n-api.service[61860]: X-User-Id: a6c3f5f97f8d4380a97913a14fda79df Apr 11 23:08:18 user devstack@n-api.service[61860]: X-User-Name: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:18 user devstack@n-api.service[61860]: method: > Apr 11 23:08:18 user devstack@n-api.service[61860]: exception: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61860]: action_args: {'id': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'} Apr 11 23:08:18 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Returning 404 to user: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-83031d9e-06c7-4bbb-87c8-9a70af9c38cf tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 404 len: 111 microversion: 2.42 time: 0.041880 Apr 11 23:08:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 89/269] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:08:18 2023] DELETE /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] [instance: 89644573-5fbc-4ab4-a16b-23b7c4f6c598] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] HTTP exception thrown: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Request method failure captured: Apr 11 23:08:18 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 HTTP/1.1 Apr 11 23:08:18 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:08:18 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:08:18 user devstack@n-api.service[61861]: Connection: close Apr 11 23:08:18 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:08:18 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:08:18 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:08:18 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:08:18 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNed0QW8-M25mGB3KL_izwZnq3UNSneWviTs5Lb6WueSLd0G9cFyC2llECu_odGDkcDvV8rifK2uYGzrKQu9wv5R1YmmfnmbISg2yDRjZyR4piyXKv9A-dOD3yadeHsRGxkSgZjPDcKuDn3Ljop26BzJYAitLzE1B7ZY7f8Nx8I7YJkE Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Project-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d2ea0b8c8a4b4a1cac18e97464975fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d2ea0b8c8a4b4a1cac18e97464975fab"}]}] Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Tenant: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Tenant-Id: d2ea0b8c8a4b4a1cac18e97464975fab Apr 11 23:08:18 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-604376384 Apr 11 23:08:18 user devstack@n-api.service[61861]: X-User: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:18 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:08:18 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:08:18 user devstack@n-api.service[61861]: X-User-Id: a6c3f5f97f8d4380a97913a14fda79df Apr 11 23:08:18 user devstack@n-api.service[61861]: X-User-Name: tempest-TaggedBootDevicesTest_v242-604376384-project-member Apr 11 23:08:18 user devstack@n-api.service[61861]: method: > Apr 11 23:08:18 user devstack@n-api.service[61861]: exception: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61861]: action_args: {'id': '89644573-5fbc-4ab4-a16b-23b7c4f6c598'} Apr 11 23:08:18 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. Apr 11 23:08:18 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:08:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] Returning 404 to user: Instance 89644573-5fbc-4ab4-a16b-23b7c4f6c598 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bf423625-5b22-43ca-9d4b-9da5aefb2b3e tempest-TaggedBootDevicesTest_v242-604376384 tempest-TaggedBootDevicesTest_v242-604376384-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598" status: 404 len: 111 microversion: 2.42 time: 0.046893 Apr 11 23:08:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 90/270] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:18 2023] GET /compute/v2.1/servers/89644573-5fbc-4ab4-a16b-23b7c4f6c598 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HTTP exception thrown: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Request method failure captured: Apr 11 23:08:20 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 HTTP/1.1 Apr 11 23:08:20 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:08:20 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:08:20 user devstack@n-api.service[61859]: Connection: close Apr 11 23:08:20 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:08:20 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:08:20 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:08:20 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:08:20 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeCgOBVuvGgk4arA9WBnhm8QWpvFGxOrqVhjWsngnOF2eobuqutPMVd60btJ59G32CckDrxP2GIGCH1T0XkFf8KMPzTxIF4EpLoy2rtEQnNTDjV7o48ensPJutZc5rqFGYaA3sXQzI1u9rj-OQAxBTNjyRwXAuNOTtwaTK7xMXeldE Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Project-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Project-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4baaf4c6d66541b79d15d024804d934c"}]}] Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Tenant: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Tenant-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:20 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-User: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:20 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:08:20 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:08:20 user devstack@n-api.service[61859]: X-User-Id: 92d65920f60d4b0e811cf0bd7df65d35 Apr 11 23:08:20 user devstack@n-api.service[61859]: X-User-Name: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:20 user devstack@n-api.service[61859]: method: > Apr 11 23:08:20 user devstack@n-api.service[61859]: exception: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61859]: action_args: {'id': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'} Apr 11 23:08:20 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Returning 404 to user: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e1825937-657a-4b38-92c1-2bc7c6d37d2b tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 404 len: 111 microversion: 2.32 time: 0.040560 Apr 11 23:08:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 92/271] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:08:20 2023] DELETE /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] [instance: f59cffaa-b1e0-427d-b395-1043bad9a5c7] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] HTTP exception thrown: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Request method failure captured: Apr 11 23:08:20 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 HTTP/1.1 Apr 11 23:08:20 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:08:20 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:08:20 user devstack@n-api.service[61860]: Connection: close Apr 11 23:08:20 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:08:20 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:08:20 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:08:20 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:08:20 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeCgOBVuvGgk4arA9WBnhm8QWpvFGxOrqVhjWsngnOF2eobuqutPMVd60btJ59G32CckDrxP2GIGCH1T0XkFf8KMPzTxIF4EpLoy2rtEQnNTDjV7o48ensPJutZc5rqFGYaA3sXQzI1u9rj-OQAxBTNjyRwXAuNOTtwaTK7xMXeldE Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Project-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Project-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4baaf4c6d66541b79d15d024804d934c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4baaf4c6d66541b79d15d024804d934c"}]}] Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Tenant: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Tenant-Id: 4baaf4c6d66541b79d15d024804d934c Apr 11 23:08:20 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1216653283 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-User: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:20 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:08:20 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:08:20 user devstack@n-api.service[61860]: X-User-Id: 92d65920f60d4b0e811cf0bd7df65d35 Apr 11 23:08:20 user devstack@n-api.service[61860]: X-User-Name: tempest-TaggedBootDevicesTest-1216653283-project-member Apr 11 23:08:20 user devstack@n-api.service[61860]: method: > Apr 11 23:08:20 user devstack@n-api.service[61860]: exception: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61860]: action_args: {'id': 'f59cffaa-b1e0-427d-b395-1043bad9a5c7'} Apr 11 23:08:20 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. Apr 11 23:08:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] Returning 404 to user: Instance f59cffaa-b1e0-427d-b395-1043bad9a5c7 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d446fec5-03d6-484b-87ae-9606651bc3a3 tempest-TaggedBootDevicesTest-1216653283 tempest-TaggedBootDevicesTest-1216653283-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7" status: 404 len: 111 microversion: 2.32 time: 0.055557 Apr 11 23:08:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 90/272] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:20 2023] GET /compute/v2.1/servers/f59cffaa-b1e0-427d-b395-1043bad9a5c7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-cd898808-9af1-455e-993f-90fcbe217a32 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046605 Apr 11 23:08:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 91/273] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:08:21 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:08:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7851001a-f858-48d2-8b74-05e386a5e67d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687" status: 204 len: 0 microversion: 2.1 time: 0.143751 Apr 11 23:08:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 93/274] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:08:21 2023] DELETE /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9554290c1a944393b68875dbadee5e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204fa09429ce4f2fafbc532805a346bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ed9a5547-cfa8-491e-9a37-1e1e5ab854d7 tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687" status: 200 len: 1650 microversion: 2.1 time: 0.238277 Apr 11 23:08:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 91/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:21 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 => generated 1650 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "name": "network-vif-unplugged", "status": "completed", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] Creating event network-vif-unplugged:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:08:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-610bb6e8-31a5-4dec-9255-b8d580efaebb req-7dfbe180-5962-4bfc-a67d-9ebb881d8fff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033481 Apr 11 23:08:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 92/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:08:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c7f3aa51-ded6-4a8f-8c04-fd7a33d0ee5e tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 204 len: 0 microversion: 2.1 time: 0.217658 Apr 11 23:08:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 94/277] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:08:23 2023] DELETE /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9d1ca075-76ae-44a0-9d8f-a1cb3e3cffc4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 200 len: 1498 microversion: 2.1 time: 0.373458 Apr 11 23:08:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 92/278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:23 2023] GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 1498 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "name": "network-vif-plugged", "status": "completed", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] Creating event network-vif-plugged:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:08:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c66a1c3e-2db3-4732-bc63-5a072b89aaaf req-80951040-b120-460f-9a80-94338ce01e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049790 Apr 11 23:08:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "name": "network-vif-unplugged", "status": "completed", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:24 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] Creating event network-vif-unplugged:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:08:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c56a30bf-c1f3-4c90-bdd1-e6fd6b4f30ed req-1fa63297-e8c8-4062-9613-9ee43fac871c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065684 Apr 11 23:08:24 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 95/280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "name": "network-vif-plugged", "status": "completed", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:24 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] Creating event network-vif-plugged:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:08:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-584b421f-29d0-4d27-a036-9d1c2a05537a req-5b681f94-d2ba-4b64-8af7-72eada1c5bb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098366 Apr 11 23:08:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 93/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6517f0-c4f0-4b35-a94a-610058ecc687", "name": "network-vif-deleted", "tag": "37163c3c-1128-4143-af68-134f3f922fa2"}, {"server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "name": "network-vif-deleted", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=35 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Creating event network-vif-deleted:37163c3c-1128-4143-af68-134f3f922fa2 for instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 on user Apr 11 23:08:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] Creating event network-vif-deleted:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:08:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1af195da-7d48-4941-b5cf-e6fbf2ef4f45 req-eea4207f-bb1a-4557-b4d5-90e57324f307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044872 Apr 11 23:08:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 94/282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:26 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11799d90-83b6-4553-9a8f-287fdbb3cf3a", "name": "network-vif-plugged", "status": "completed", "tag": "7119bc80-98eb-47d6-b1b7-3ad91cae4256"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] Creating event network-vif-plugged:7119bc80-98eb-47d6-b1b7-3ad91cae4256 for instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a on user Apr 11 23:08:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-263f5ebc-ce20-48cb-b9f4-58678a825c73 req-424fe2c8-b07c-4105-97a8-d02efdc63d4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Apr 11 23:08:26 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 96/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "name": "network-vif-plugged", "status": "completed", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] Creating event network-vif-plugged:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:08:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2827eb66-098e-4cd7-b715-dd036804c660 req-ed2cbcd6-b857-4bf0-9050-f729f6d290b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028041 Apr 11 23:08:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:29 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:29 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a221a43c-f8e7-4e38-87aa-b34e2d49926b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1658 microversion: 2.1 time: 0.182675 Apr 11 23:08:29 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 95/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:29 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1658 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f2d798b-8277-4bd3-a36e-dd47771c3f8d"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e0faadd6-4b12-44c6-b3bb-6eda15f038c8 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407841 Apr 11 23:08:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 97/286] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:08:29 2023] POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:30 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-54fbf026-c2b9-474a-aabf-12bc78da146b tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1670 microversion: 2.1 time: 0.314620 Apr 11 23:08:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:30 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1670 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d576508-63a9-4c1c-8b86-952f4522ecd4"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:31 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-690a5a48-83b8-4c58-8e68-f40ffdce2350 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380906 Apr 11 23:08:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 96/288] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:08:31 2023] POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12247dde-59fb-47e6-b624-bc8b349687a0"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fbc5a167-6f69-4284-b039-dc2cb85c490e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454962 Apr 11 23:08:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 98/289] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 23:08:37 2023] POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments => generated 188 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:38 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61860) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 23:08:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ff926d3d-483f-40fd-b422-f372cbb7800b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/action" status: 202 len: 0 microversion: 2.20 time: 0.582074 Apr 11 23:08:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 96/290] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:08:37 2023] POST /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:38 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4c9becd0-0dc4-460e-84dc-7f4311ec6251 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1735 microversion: 2.20 time: 0.239712 Apr 11 23:08:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 97/291] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:38 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:38 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-db5d353b-0262-443f-aae6-77b5ebd20fc5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1704 microversion: 2.1 time: 0.186585 Apr 11 23:08:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 99/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:38 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1704 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1247380178", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: dict_keys(['metadata_items']) {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: dict_keys(['metadata_items']) {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-df3a15ac-a071-4965-94a0-363fdc53fbe7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action" status: 202 len: 1159 microversion: 2.1 time: 0.488991 Apr 11 23:08:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 97/293] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 23:08:39 2023] POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action => generated 1159 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:39 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:39 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c2679a5f-ac9a-49d4-80c5-71465a9d8ffc tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1732 microversion: 2.1 time: 0.332554 Apr 11 23:08:39 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:39 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1732 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] Creating event network-vif-unplugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:08:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-785754af-06a3-4fea-9fad-c69e9375292b req-43a932c6-c2e7-49b0-99aa-46c840f911b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058726 Apr 11 23:08:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1d98e55d-ff92-4ffd-ba89-2fe05e161b7a"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:40 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'flavor' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:08:40 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-2829f4a4-d246-4fe9-9bdf-06edb4930856 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action" status: 200 len: 29 microversion: 2.1 time: 0.293606 Apr 11 23:08:40 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 98/296] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:08:40 2023] POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action => generated 29 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:41 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0b6ece02-a345-4032-976b-83810cd80676 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1722 microversion: 2.1 time: 0.467867 Apr 11 23:08:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:40 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}, {"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-unplugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:08:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] Creating event network-vif-unplugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:08:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-774504be-f457-49a7-9cfe-d4a36e06ceab req-67cf0d8c-6493-4af9-ae77-52c5beb13ee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.070379 Apr 11 23:08:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 101/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-437538c2-96dd-43e7-87ea-131bd8a0f121 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: .version_select at 0x7f31579f3d90>, body: {"keypair": {"name": "tempest-keypair-1101679830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0zqkr5JslO5pazVYnbydw15T9EjvLg2GhWoOpKqa/Wjsgfn0KXK0Lu5zOBrtqyynlBKK+TPkpstQuZbuDS46amji1YuAoDEopw7Gf9EJdnvh6SOK92JvEf778W3uX0Dg=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:43 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-437538c2-96dd-43e7-87ea-131bd8a0f121 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:43 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-437538c2-96dd-43e7-87ea-131bd8a0f121 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-437538c2-96dd-43e7-87ea-131bd8a0f121 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226981 Apr 11 23:08:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 99/299] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:08:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:08:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-02310b51-356c-40d0-b8b0-93f3b3201958 req-65590be3-67e0-4c09-b3f3-b2eedf46b9c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042183 Apr 11 23:08:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 100/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:44 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-426c4666-6b18-4319-a08e-d2ecd7638864 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb" status: 200 len: 1495 microversion: 2.1 time: 0.301004 Apr 11 23:08:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:44 2023] GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb => generated 1495 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:45 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-97bd473a-6b59-4a9c-8883-fa247d88799c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: .version_select at 0x7f31579f2830>, body: {"keypair": {"name": "tempest-keypair-759307061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBCZV7mfgey8l84oWxyLPmpf/vUdIecbJfbZusGcLaLsUyVaAO/eUu8uumuNjaCqYf3u0A6YOPq2RC4XZqaH6cL8LKWE4mILFzbc1EBe4QFoOM0qAj4Mr6qKrIzOcb4DQ=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:45 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-97bd473a-6b59-4a9c-8883-fa247d88799c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:45 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-97bd473a-6b59-4a9c-8883-fa247d88799c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for user 1793cec543e8425899474614b2c10f5d and project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:45 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-97bd473a-6b59-4a9c-8883-fa247d88799c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108264 Apr 11 23:08:45 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 100/302] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:08:45 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-294909853", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f013a872-a4db-4d26-8b73-353db89b647e"}], "security_groups": [{"name": "tempest-securitygroup--289986747"}], "key_name": "tempest-keypair-1101679830", "user_data": "}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:46 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] validate_networks() for [('f013a872-a4db-4d26-8b73-353db89b647e', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:08:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:08:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-362ec59b-581d-4253-a895-d661fa544fab req-8ef5be74-0172-43d9-9360-993189954528 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Apr 11 23:08:47 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 103/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:08:47 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:08:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-03ba7050-ad12-4604-b1c7-5389cd4c0d79 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.023850 Apr 11 23:08:47 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 101/304] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:08:46 2023] POST /compute/v2.1/servers => generated 399 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 23:08:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-393b7565-569e-4cfe-b130-15105080cd9b tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:47 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-393b7565-569e-4cfe-b130-15105080cd9b tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:47 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-393b7565-569e-4cfe-b130-15105080cd9b tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-393b7565-569e-4cfe-b130-15105080cd9b tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 200 len: 1235 microversion: 2.1 time: 0.145890 Apr 11 23:08:47 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:47 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 1235 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] Creating event network-changed:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:08:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6a60259c-ac19-4c08-a2a7-8a1172606a73 req-84a03d10-507d-4c35-993d-6708433bdf1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044477 Apr 11 23:08:47 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 104/306] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-306537180", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909"}], "security_groups": [{"name": "tempest-securitygroup--1676566085"}], "key_name": "tempest-keypair-759307061", "user_data": "}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] validate_networks() for [('c4d6de35-af1a-4dd1-9efe-b1b10bbcc909', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for user 1793cec543e8425899474614b2c10f5d and project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:08:48 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:08:48 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3535f5f4-7a4f-43fe-903a-21a6c0fe5011 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.637899 Apr 11 23:08:48 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 102/307] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:08:48 2023] POST /compute/v2.1/servers => generated 400 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:08:48 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-01929c8f-17d7-43e9-8963-61b4d0f16e5f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:48 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-01929c8f-17d7-43e9-8963-61b4d0f16e5f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:48 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-01929c8f-17d7-43e9-8963-61b4d0f16e5f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:08:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-01929c8f-17d7-43e9-8963-61b4d0f16e5f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1230 microversion: 2.1 time: 0.109308 Apr 11 23:08:48 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:08:48 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:08:49 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:49 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:08:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-1419a26e-2325-4078-872a-e5c5ac537fc1 req-e0831c93-e82c-46d3-b859-ce6f1c45be89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042153 Apr 11 23:08:49 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 105/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] Creating event network-changed:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:08:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-8e8e574b-4390-4f8f-ab05-5fa2505f44a8 req-5bebc075-c852-4311-93bb-f829bfdf8a61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042149 Apr 11 23:08:53 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 103/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=7,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:08:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-5c68e47d-6d1f-49fa-9912-c3f7a2e60545 req-fac2da09-213e-4ced-9a30-b9ea7fe8f4c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056540 Apr 11 23:08:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 103/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:55 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:55 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:55 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] Creating event network-changed:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:08:55 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0dd08ff4-4371-4a16-8b62-6700ab653181 req-dad1fef7-02db-4f96-a1b2-cffbdc77bf4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028835 Apr 11 23:08:55 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 106/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:55 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:08:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-2c025939-07c4-462b-b6e8-46a224af4f80 req-e120000b-de1c-4f99-ac3b-1516ce01636e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071511 Apr 11 23:08:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 104/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:57 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "name": "network-vif-plugged", "status": "completed", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:57 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] Creating event network-vif-plugged:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:08:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b97cea28-8f27-45ba-82f2-653d961bd025 req-50ba71fe-1c96-42a8-95ba-ddafc7ca2ad7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054670 Apr 11 23:08:57 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 104/314] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=24 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:57 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:08:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-f0cb14f3-4277-4480-becf-9fcfc7b80050 req-8bbe570f-c535-4e0b-a2a6-8d4f063b2006 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054247 Apr 11 23:08:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "name": "network-vif-plugged", "status": "completed", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}, {"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}, {"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Creating event network-vif-plugged:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:08:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:08:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:08:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c0b2610a-d586-4a74-be2f-10a957d5c5aa req-ee5c58cf-8288-423a-8b02-45acedf2c9af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063683 Apr 11 23:08:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:59 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:08:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:08:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:08:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:08:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] HTTP exception thrown: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Request method failure captured: Apr 11 23:08:59 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 HTTP/1.1 Apr 11 23:08:59 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:08:59 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:08:59 user devstack@n-api.service[61860]: Connection: close Apr 11 23:08:59 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:08:59 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:08:59 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:08:59 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:08:59 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeE--5S7tx0NltAyN5tAxUd1-wgE-R59bdWH9dMlhIRxWd9BSNx1BY31zHIhQBSvZxEyMUbPJT2ElgNFQAULPsKwTS5n1xFCMOFm8U4w6RH8ZQLx0N0ZWb0_C93lxYY742xSfW9aDxwYTTj9PMTiMIQIQLDsaeXZlNnHXffNTJ8R5k Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Project-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Project-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/35fb372296e5430e9f915be720934494"}]}] Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Tenant: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Tenant-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:08:59 user devstack@n-api.service[61860]: X-User: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:08:59 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:08:59 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:08:59 user devstack@n-api.service[61860]: X-User-Id: 343064f07762476ca5221be36dcbd0de Apr 11 23:08:59 user devstack@n-api.service[61860]: X-User-Name: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:08:59 user devstack@n-api.service[61860]: method: > Apr 11 23:08:59 user devstack@n-api.service[61860]: exception: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:08:59 user devstack@n-api.service[61860]: action_args: {'id': '902899b9-8c8f-404e-a110-832b3c91d526'} Apr 11 23:08:59 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:08:59 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:08:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Returning 404 to user: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:08:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eab07aed-ebad-4cb4-8ba8-3c639b88c898 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 404 len: 111 microversion: 2.49 time: 0.044297 Apr 11 23:08:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 105/317] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:08:59 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:08:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-056c480b-f718-4e15-b457-6b224df61c10 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '.version_select at 0x7f3157aa6680>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:08:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:08:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-4022bbc7-dc44-4c70-b1ef-fce2ac1470d0 req-138ab377-fa87-40a1-b625-1f47fc209bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050717 Apr 11 23:08:59 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:08:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-056c480b-f718-4e15-b457-6b224df61c10 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602402085" status: 204 len: 0 microversion: 2.49 time: 0.032968 Apr 11 23:08:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 106/319] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 23:08:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602402085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] HTTP exception thrown: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Request method failure captured: Apr 11 23:09:02 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 HTTP/1.1 Apr 11 23:09:02 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:09:02 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:09:02 user devstack@n-api.service[61860]: Connection: close Apr 11 23:09:02 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:09:02 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:09:02 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:09:02 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:09:02 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeE--5S7tx0NltAyN5tAxUd1-wgE-R59bdWH9dMlhIRxWd9BSNx1BY31zHIhQBSvZxEyMUbPJT2ElgNFQAULPsKwTS5n1xFCMOFm8U4w6RH8ZQLx0N0ZWb0_C93lxYY742xSfW9aDxwYTTj9PMTiMIQIQLDsaeXZlNnHXffNTJ8R5k Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Project-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Project-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/35fb372296e5430e9f915be720934494"}]}] Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Tenant: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Tenant-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61860]: X-User: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:09:02 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:09:02 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:09:02 user devstack@n-api.service[61860]: X-User-Id: 343064f07762476ca5221be36dcbd0de Apr 11 23:09:02 user devstack@n-api.service[61860]: X-User-Name: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:09:02 user devstack@n-api.service[61860]: method: > Apr 11 23:09:02 user devstack@n-api.service[61860]: exception: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61860]: action_args: {'id': '902899b9-8c8f-404e-a110-832b3c91d526'} Apr 11 23:09:02 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Returning 404 to user: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:09:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c217a3d5-bd1d-4d42-98a4-2e0b50d2f97e tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 404 len: 111 microversion: 2.49 time: 0.041720 Apr 11 23:09:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 106/320] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:09:02 2023] DELETE /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] [instance: 902899b9-8c8f-404e-a110-832b3c91d526] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] HTTP exception thrown: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Request method failure captured: Apr 11 23:09:02 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 HTTP/1.1 Apr 11 23:09:02 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:09:02 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:09:02 user devstack@n-api.service[61859]: Connection: close Apr 11 23:09:02 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:09:02 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:09:02 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:09:02 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:09:02 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeE--5S7tx0NltAyN5tAxUd1-wgE-R59bdWH9dMlhIRxWd9BSNx1BY31zHIhQBSvZxEyMUbPJT2ElgNFQAULPsKwTS5n1xFCMOFm8U4w6RH8ZQLx0N0ZWb0_C93lxYY742xSfW9aDxwYTTj9PMTiMIQIQLDsaeXZlNnHXffNTJ8R5k Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Project-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Project-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/35fb372296e5430e9f915be720934494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/35fb372296e5430e9f915be720934494"}]}] Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Tenant: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Tenant-Id: 35fb372296e5430e9f915be720934494 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2113709125 Apr 11 23:09:02 user devstack@n-api.service[61859]: X-User: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:09:02 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:09:02 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:09:02 user devstack@n-api.service[61859]: X-User-Id: 343064f07762476ca5221be36dcbd0de Apr 11 23:09:02 user devstack@n-api.service[61859]: X-User-Name: tempest-TaggedAttachmentsTest-2113709125-project-member Apr 11 23:09:02 user devstack@n-api.service[61859]: method: > Apr 11 23:09:02 user devstack@n-api.service[61859]: exception: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61859]: action_args: {'id': '902899b9-8c8f-404e-a110-832b3c91d526'} Apr 11 23:09:02 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. Apr 11 23:09:02 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:09:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] Returning 404 to user: Instance 902899b9-8c8f-404e-a110-832b3c91d526 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:09:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5b35b98b-3b22-456e-a50f-f6a710580744 tempest-TaggedAttachmentsTest-2113709125 tempest-TaggedAttachmentsTest-2113709125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526" status: 404 len: 111 microversion: 2.49 time: 0.034924 Apr 11 23:09:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 109/321] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:09:02 2023] GET /compute/v2.1/servers/902899b9-8c8f-404e-a110-832b3c91d526 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:05 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:05 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-064e1d4b-03f6-4cdc-b0ad-3c30f339369c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 200 len: 1393 microversion: 2.1 time: 0.206755 Apr 11 23:09:05 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:04 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 1393 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] [instance: 5d6517f0-c4f0-4b35-a94a-610058ecc687] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] HTTP exception thrown: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Request method failure captured: Apr 11 23:09:11 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 HTTP/1.1 Apr 11 23:09:11 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:09:11 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:09:11 user devstack@n-api.service[61860]: Connection: close Apr 11 23:09:11 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:09:11 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:09:11 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:09:11 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:09:11 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed-HhGoez7Mx6Mm4SsBdIVVqjXKVm2EaTy1kz95sFWu3TfeuE6RBLN-AiU0wb2rrJS4XIVouZ0AfHFDFFhLriR_mOxq383O90ntJm5f1Tgvu93jKTOxpdJAcZGNltnM2ccelKff2okbiveyBn0X3WjgqOTLZaaVHdvydZc3Ew6Cn9U Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Project-Id: 204fa09429ce4f2fafbc532805a346bc Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestVolumeSwap-1115138571 Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/204fa09429ce4f2fafbc532805a346bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/204fa09429ce4f2fafbc532805a346bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/204fa09429ce4f2fafbc532805a346bc"}]}] Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Tenant: tempest-TestVolumeSwap-1115138571 Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Tenant-Id: 204fa09429ce4f2fafbc532805a346bc Apr 11 23:09:11 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestVolumeSwap-1115138571 Apr 11 23:09:11 user devstack@n-api.service[61860]: X-User: tempest-TestVolumeSwap-1115138571-project-member Apr 11 23:09:11 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:09:11 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:09:11 user devstack@n-api.service[61860]: X-User-Id: 9554290c1a944393b68875dbadee5e63 Apr 11 23:09:11 user devstack@n-api.service[61860]: X-User-Name: tempest-TestVolumeSwap-1115138571-project-member Apr 11 23:09:11 user devstack@n-api.service[61860]: method: > Apr 11 23:09:11 user devstack@n-api.service[61860]: exception: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. Apr 11 23:09:11 user devstack@n-api.service[61860]: action_args: {'id': '5d6517f0-c4f0-4b35-a94a-610058ecc687'} Apr 11 23:09:11 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. Apr 11 23:09:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:09:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Returning 404 to user: Instance 5d6517f0-c4f0-4b35-a94a-610058ecc687 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:09:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5da01587-14c9-4528-8370-f1d7effbfd3d tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687" status: 404 len: 111 microversion: 2.1 time: 0.049755 Apr 11 23:09:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 107/323] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:11 2023] GET /compute/v2.1/servers/5d6517f0-c4f0-4b35-a94a-610058ecc687 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 23:09:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d7a52771-e034-4e3d-a074-88b02595f07a tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] Calling method '.version_select at 0x7f3157805630>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d7a52771-e034-4e3d-a074-88b02595f07a tempest-TestVolumeSwap-1115138571 tempest-TestVolumeSwap-1115138571-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498862326" status: 202 len: 0 microversion: 2.1 time: 0.033073 Apr 11 23:09:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 110/324] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:09:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498862326 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] HTTP exception thrown: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:09:14 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a HTTP/1.1 Apr 11 23:09:14 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:09:14 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:09:14 user devstack@n-api.service[61861]: Connection: close Apr 11 23:09:14 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:09:14 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:09:14 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:09:14 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:09:14 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:09:14 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:09:14 user devstack@n-api.service[61861]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:09:14 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:09:14 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:09:14 user devstack@n-api.service[61861]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:09:14 user devstack@n-api.service[61861]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:09:14 user devstack@n-api.service[61861]: method: > Apr 11 23:09:14 user devstack@n-api.service[61861]: exception: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:09:14 user devstack@n-api.service[61861]: action_args: {'id': '11799d90-83b6-4553-9a8f-287fdbb3cf3a'} Apr 11 23:09:14 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:09:14 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 404 to user: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:09:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-1bfc79e9-51b5-412b-b008-9242c3ed99f0 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 404 len: 111 microversion: 2.1 time: 0.051661 Apr 11 23:09:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:13 2023] GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ff6f1d8b-4f98-43db-8e15-c6d6d737feed tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1492 microversion: 2.1 time: 0.535864 Apr 11 23:09:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:14 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1492 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=5 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:29 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:29 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:29 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-95601025-6f9e-4daf-a167-175b1fb3d749 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1780 microversion: 2.20 time: 0.554097 Apr 11 23:09:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 111/327] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:09:28 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1780 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=9 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:30 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-df8579b7-e960-4cc8-b5bf-a30556e8aa2a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.498193 Apr 11 23:09:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 109/328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:29 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=9 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=16 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:31 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3f6b4fb8-f693-4d28-8762-f2e25824192f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1702 microversion: 2.1 time: 0.227510 Apr 11 23:09:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:31 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1702 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1735343577", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "3b8208aa-b1fb-4696-a19a-fde2229542d2"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] validate_networks() for [('3b8208aa-b1fb-4696-a19a-fde2229542d2', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Getting quotas for project db2b607b5736495895de9c423eeb7443. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Getting quotas for user 190187c84d9a42e4a6f6e2a834cae8eb and project db2b607b5736495895de9c423eeb7443. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:09:33 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:09:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a8a52892-7c1f-4e81-bdde-e1268761e6df tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.608876 Apr 11 23:09:33 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 112/330] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:09:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:09:33 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-49fa841e-7a63-4c15-8728-0ab2853e7dda tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:33 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-49fa841e-7a63-4c15-8728-0ab2853e7dda tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:33 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-49fa841e-7a63-4c15-8728-0ab2853e7dda tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190187c84d9a42e4a6f6e2a834cae8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b607b5736495895de9c423eeb7443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-49fa841e-7a63-4c15-8728-0ab2853e7dda tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 200 len: 1209 microversion: 2.1 time: 0.068808 Apr 11 23:09:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 110/331] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:33 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 1209 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] Creating event network-changed:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:09:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9348dcc3-5cd4-41c1-99a5-03b781e8421e req-eea06567-b017-4e3a-8993-f4844ee2be3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048120 Apr 11 23:09:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:37 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7facc193-b812-4bd6-b723-a853d00ef3a2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 200 len: 1542 microversion: 2.1 time: 0.155149 Apr 11 23:09:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 113/333] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:37 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "name": "network-vif-plugged", "status": "completed", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] Creating event network-vif-plugged:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:09:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-361d41f1-a1a2-4da9-b258-089f3ffd455b req-d652d536-9ae9-4ede-aa5e-1a79fcb50701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065090 Apr 11 23:09:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:39 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f75fbecd-95b9-4be1-82ef-d7c9bd839c36 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1535 microversion: 2.1 time: 0.166093 Apr 11 23:09:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:39 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1535 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "name": "network-vif-plugged", "status": "completed", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] Creating event network-vif-plugged:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:09:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b5d093ec-20b0-4ce5-bb36-5de2e80b0bfa req-e46f0a87-01be-42f7-8ea6-d7dee90c6fa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028921 Apr 11 23:09:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 114/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "682792b5-b446-469a-8555-8405bbdf405a"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] HTTP exception thrown: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Request method failure captured: Apr 11 23:09:46 user devstack@n-api.service[61861]: request: PUT /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb/os-volume_attachments/0f8c23be-3cd8-4e2a-bc62-f1ea782015bd HTTP/1.1 Apr 11 23:09:46 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:09:46 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:09:46 user devstack@n-api.service[61861]: Connection: close Apr 11 23:09:46 user devstack@n-api.service[61861]: Content-Length: 74 Apr 11 23:09:46 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:09:46 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:09:46 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:09:46 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeeT1RwFbvTVmslP3UlGnwiieOVWabZ5osNNX3ClUpKLXetkw4ampajKe5bZM2HDbhc7HyVXWPm6WFaJCh5C4jXm3uVtZY4TDVqD7EgQRPb64FtBR_68QPHiYyuiMUTF95IDotbdVmlQfbjS_CjUhEwgQKdv8n8Lh3JGbL1XnPUgZHM Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Project-Id: 23f739656dd9476fb285a1c6796c1e89 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Role: member,reader,admin Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Roles: member,reader,admin Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23f739656dd9476fb285a1c6796c1e89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23f739656dd9476fb285a1c6796c1e89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23f739656dd9476fb285a1c6796c1e89"}]}] Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Tenant-Id: 23f739656dd9476fb285a1c6796c1e89 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1100076750 Apr 11 23:09:46 user devstack@n-api.service[61861]: X-User: tempest-VolumesAdminNegativeTest-1100076750-project-admin Apr 11 23:09:46 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:09:46 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:09:46 user devstack@n-api.service[61861]: X-User-Id: ce1f5293b3e94b6fa1e38cd4b9c40d1a Apr 11 23:09:46 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesAdminNegativeTest-1100076750-project-admin Apr 11 23:09:46 user devstack@n-api.service[61861]: Apr 11 23:09:46 user devstack@n-api.service[61861]: {"volumeAttachment": {"volumeId": "682792b5-b446-469a-8555-8405bbdf405a"}} Apr 11 23:09:46 user devstack@n-api.service[61861]: method: > Apr 11 23:09:46 user devstack@n-api.service[61861]: exception: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. Apr 11 23:09:46 user devstack@n-api.service[61861]: action_args: {'server_id': '04b926fc-370b-485a-ad51-944ba0791ebb', 'id': '0f8c23be-3cd8-4e2a-bc62-f1ea782015bd', 'body': {'volumeAttachment': {'volumeId': '682792b5-b446-469a-8555-8405bbdf405a'}}} Apr 11 23:09:46 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. (HTTP 404) (Request-ID: req-483be8ab-7d46-49f3-a376-1fe8fdca5934) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. Apr 11 23:09:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:09:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] Returning 404 to user: Volume 0f8c23be-3cd8-4e2a-bc62-f1ea782015bd could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:09:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7cf4bfec-a137-4df4-b2ac-46290fe41255 tempest-VolumesAdminNegativeTest-1100076750 tempest-VolumesAdminNegativeTest-1100076750-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb/os-volume_attachments/0f8c23be-3cd8-4e2a-bc62-f1ea782015bd" status: 404 len: 109 microversion: 2.1 time: 0.110297 Apr 11 23:09:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 112/337] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 23:09:46 2023] PUT /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb/os-volume_attachments/0f8c23be-3cd8-4e2a-bc62-f1ea782015bd => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:48 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:09:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6954c052-0cb4-42b1-889f-3b1fd6ba22bd tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb" status: 204 len: 0 microversion: 2.1 time: 0.118698 Apr 11 23:09:48 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:09:48 2023] DELETE /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:48 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:09:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-34dc8158-82df-4142-bb1a-a82758dfa387 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb" status: 200 len: 1501 microversion: 2.1 time: 0.192121 Apr 11 23:09:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 115/339] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:09:48 2023] GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:09:49 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "name": "network-vif-unplugged", "status": "completed", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:49 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] Creating event network-vif-unplugged:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:09:49 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1e0e94b2-312d-41c8-9254-ab98056fdbb6 req-3ca251f8-8c3c-43f0-9295-cc0ddf109030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030155 Apr 11 23:09:49 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:09:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:09:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "name": "network-vif-plugged", "status": "completed", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}, {"server_uuid": "04b926fc-370b-485a-ad51-944ba0791ebb", "name": "network-vif-deleted", "tag": "dc4b3a29-90e2-4b93-838d-a01ef7479bfb"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:09:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:09:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:09:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:09:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Creating event network-vif-plugged:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:09:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] Creating event network-vif-deleted:dc4b3a29-90e2-4b93-838d-a01ef7479bfb for instance 04b926fc-370b-485a-ad51-944ba0791ebb on user Apr 11 23:09:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-1f1b0cc1-5f66-43fd-87ca-73adbdcd8250 req-adcc0266-7127-47e2-a587-784be56796db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.145991 Apr 11 23:09:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:09:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=22 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:05 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e5abebdb-7b30-4a4d-b51e-b7c7dae30e3e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 200 len: 1393 microversion: 2.1 time: 0.290738 Apr 11 23:10:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 116/342] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:05 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=14 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1675638732"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:05 user devstack@n-api.service[61861]: INFO nova.compute.api [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Attempting to quiesce instance before volume snapshot. Apr 11 23:10:05 user devstack@n-api.service[61861]: INFO nova.compute.api [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 23:10:05 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Creating snapshot from volume 1f79365f-d1d4-4c01-94f3-205e20bec9d5. {{(pid=61861) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 23:10:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-941c4e8c-f178-4bc3-9b73-671f3aa7986c tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe/action" status: 202 len: 0 microversion: 2.1 time: 2.592316 Apr 11 23:10:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 114/343] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:10:05 2023] POST /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe/action => generated 0 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-520243177", "imageRef": "17af8c22-c9d1-475f-8a37-adcc7b531013", "flavorRef": "42", "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:10:08 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d08dee79-c518-43b4-a83e-3d243a253f4d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:10:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5a3e9037-a621-4a4c-af93-702fc6a67345 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.715921 Apr 11 23:10:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 114/344] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:10:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:10:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fb611b7a-1d0f-4e0b-a815-d7699fd1e1ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:08 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fb611b7a-1d0f-4e0b-a815-d7699fd1e1ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:08 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-fb611b7a-1d0f-4e0b-a815-d7699fd1e1ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:08 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fb611b7a-1d0f-4e0b-a815-d7699fd1e1ff tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 200 len: 1223 microversion: 2.1 time: 0.067593 Apr 11 23:10:08 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:08 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1327390659", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "9d69aaba-efae-4f2d-892b-03a069468558"}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:09 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] validate_networks() for [('9d69aaba-efae-4f2d-892b-03a069468558', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting quotas for project 154fad18f802436d95b15503e470d942. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting quotas for user e3995d8045154666b0ae890dd3de5ef3 and project 154fad18f802436d95b15503e470d942. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:10:10 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:10:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-63129f06-1d1b-481b-a5ec-924837098c72 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.680664 Apr 11 23:10:10 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 115/346] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:10:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:10:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-981915d7-01d4-4380-8ef5-c4d647816553 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:10 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-981915d7-01d4-4380-8ef5-c4d647816553 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:10 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-981915d7-01d4-4380-8ef5-c4d647816553 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-981915d7-01d4-4380-8ef5-c4d647816553 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9" status: 200 len: 1213 microversion: 2.1 time: 0.069913 Apr 11 23:10:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:10 2023] GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] Creating event network-changed:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:10:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b310f181-0b13-4dfb-b58b-30153b2489b6 req-26542f61-385e-452b-9231-660a1a8a97da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028404 Apr 11 23:10:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 118/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] Creating event network-changed:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:10:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ffe8c376-8b5e-4e2a-ad9f-ed67dee6b7b0 req-9372edbb-517b-4710-a19e-8db9d254bd3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028770 Apr 11 23:10:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 116/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "name": "network-vif-plugged", "status": "completed", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] Creating event network-vif-plugged:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:10:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-1b0f4082-3d1b-462d-9602-7f9193cfe9cd req-b603a187-1d35-4b48-b8d2-a18b36878fa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281124 Apr 11 23:10:15 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5ea1645f-841a-47ac-96b8-b362f58f3247 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1703048880", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3fa8108a-3975-4c64-907c-1ba5c1c56de1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-5ea1645f-841a-47ac-96b8-b362f58f3247 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] HTTP exception thrown: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. Apr 11 23:10:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5ea1645f-841a-47ac-96b8-b362f58f3247 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:10:16 user devstack@n-api.service[61859]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 23:10:16 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:10:16 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:10:16 user devstack@n-api.service[61859]: Connection: close Apr 11 23:10:16 user devstack@n-api.service[61859]: Content-Length: 357 Apr 11 23:10:16 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:10:16 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:10:16 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:10:16 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:10:16 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:10:16 user devstack@n-api.service[61859]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:10:16 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:10:16 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:10:16 user devstack@n-api.service[61859]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:10:16 user devstack@n-api.service[61859]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:10:16 user devstack@n-api.service[61859]: Apr 11 23:10:16 user devstack@n-api.service[61859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1703048880", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3fa8108a-3975-4c64-907c-1ba5c1c56de1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} Apr 11 23:10:16 user devstack@n-api.service[61859]: method: > Apr 11 23:10:16 user devstack@n-api.service[61859]: exception: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. Apr 11 23:10:16 user devstack@n-api.service[61859]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1703048880', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '3fa8108a-3975-4c64-907c-1ba5c1c56de1'}], 'networks': [{'uuid': '02021ebc-33d0-4630-a873-2190cd8d8360'}]}}} Apr 11 23:10:16 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. Apr 11 23:10:16 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:10:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5ea1645f-841a-47ac-96b8-b362f58f3247 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 400 to user: Block Device 3fa8108a-3975-4c64-907c-1ba5c1c56de1 is not bootable. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:10:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5ea1645f-841a-47ac-96b8-b362f58f3247 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.073523 Apr 11 23:10:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 119/351] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:10:16 2023] POST /compute/v2.1/servers => generated 110 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:16 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6ccf6db8-7eb7-412a-9b00-b926bf001258 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1492 microversion: 2.1 time: 0.146127 Apr 11 23:10:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 117/352] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:16 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1492 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:17 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "name": "network-vif-plugged", "status": "completed", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] Creating event network-vif-plugged:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:10:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-03b11e2b-3d94-45be-94ce-f3dc6a24860d req-621823cd-b971-4013-aac4-f724a1f53211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Apr 11 23:10:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190187c84d9a42e4a6f6e2a834cae8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b607b5736495895de9c423eeb7443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a89bd34a-ed40-4794-ad48-2cbf77892622 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 200 len: 1489 microversion: 2.1 time: 0.265292 Apr 11 23:10:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 120/354] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:23 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 1489 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:10:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "name": "network-vif-plugged", "status": "completed", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] Creating event network-vif-plugged:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:10:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-067ea732-3361-466f-bcf5-11df9b86d8d0 req-ce2903de-bee0-40bd-96fd-db8c484c8a3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137739 Apr 11 23:10:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 118/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "name": "network-vif-plugged", "status": "completed", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] Creating event network-vif-plugged:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:10:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-8ceb5852-9fbf-41ee-9995-67e5a9cbd98f req-ee4ea262-8f68-4a1e-b358-ce295ee6a2cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035761 Apr 11 23:10:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bc7872b1-5423-4bb5-9210-105fa9ea3965 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments/12247dde-59fb-47e6-b624-bc8b349687a0" status: 200 len: 194 microversion: 2.20 time: 0.163430 Apr 11 23:10:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 121/357] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 23:10:29 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments/12247dde-59fb-47e6-b624-bc8b349687a0 => generated 194 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:29 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'services' on Instance uuid 8322b884-2831-48af-a67e-26c31c17f49f {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:10:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-1e14d8c1-e5d9-4e77-94e7-c3a966f6ee8d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments/12247dde-59fb-47e6-b624-bc8b349687a0" status: 202 len: 0 microversion: 2.20 time: 0.255923 Apr 11 23:10:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 119/358] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 23:10:29 2023] DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments/12247dde-59fb-47e6-b624-bc8b349687a0 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-65fba24e-6360-42e4-a025-3f03c2102cf3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048536 Apr 11 23:10:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 119/359] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 23:10:30 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ce6d87e9-4b33-46b8-9b18-bc6c38a56f13 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.332869 Apr 11 23:10:30 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 122/360] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:30 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-174a1d81-2ebe-4aba-b4df-b05cd21ee3c1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.153438 Apr 11 23:10:31 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 120/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:31 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3d509502-9357-4f6e-ad93-e73f6ae9a63f tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action" status: 202 len: 0 microversion: 2.1 time: 0.184180 Apr 11 23:10:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 120/362] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:10:31 2023] POST /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-073fca0b-7256-4b96-9756-578790dd4052 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.119476 Apr 11 23:10:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 123/363] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:10:31 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-interface => generated 283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] Creating event network-changed:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-29c9407d-d353-478a-b819-8c12944e756e req-cff8f38e-6171-4cae-87e8-5fa3375b28c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031213 Apr 11 23:10:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-unplugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] Creating event network-vif-unplugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b252ecc7-d8bf-49ab-b339-e373174ec177 req-259bca65-3a63-4926-a4d7-b759f9dd0bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044218 Apr 11 23:10:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 121/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:10:34 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:34 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] Creating event network-changed:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:34 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-e22563f1-a7f5-4463-8334-1fd2a85f3034 req-f9e7a2a0-dd3e-44c6-8b99-7554991045e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045469 Apr 11 23:10:34 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}, {"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-4413ab70-7c64-4ee6-b819-3eb6060d2ae2 req-0cd0968a-7e14-4198-af62-779c33a8203f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033811 Apr 11 23:10:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 122/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:10:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-15491837-08d8-460e-8bf8-c412eadb68fe req-1d55892b-3ff1-4452-910b-76eb21f0513c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038361 Apr 11 23:10:37 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 122/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=21 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a34e140a-0885-4675-b22e-6ae4b0530b13 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.102747 Apr 11 23:10:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 125/369] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:10:37 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-interface => generated 282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:38 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a671a99d-50bf-42a3-9d6e-d203d71b75f5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/ips" status: 200 len: 106 microversion: 2.1 time: 0.045459 Apr 11 23:10:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 123/370] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:10:38 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/ips => generated 106 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:39 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] Creating event network-changed:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:10:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c70a7fc4-dcb6-4762-96ae-21d9c4f7be94 req-d13c325b-fab0-4c29-81ca-fa8fd2817caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035363 Apr 11 23:10:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 126/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: 04b926fc-370b-485a-ad51-944ba0791ebb] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] HTTP exception thrown: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Request method failure captured: Apr 11 23:10:39 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb HTTP/1.1 Apr 11 23:10:39 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:10:39 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:10:39 user devstack@n-api.service[61860]: Connection: close Apr 11 23:10:39 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:10:39 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:10:39 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:10:39 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:10:39 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed5W3rc__J3pJ6x28JfihhIucPnEeC-TOKdHK4l4pXlK16lp_P_Xt5l2UQGbx7WNg8oeh9XzlSSyr7UyrpaPHWGxqm4WI28U3P8PAe5TVMoxn1dZu33ZBApH80-aHms-wtlIO-X20sovr463GYR5onCY47c4hB8AWLf7bkBBPLr8HM Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Project-Id: c24d77b00c084f6f857147717350b6e0 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c24d77b00c084f6f857147717350b6e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c24d77b00c084f6f857147717350b6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c24d77b00c084f6f857147717350b6e0"}]}] Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Tenant-Id: c24d77b00c084f6f857147717350b6e0 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:10:39 user devstack@n-api.service[61860]: X-User: tempest-VolumesAdminNegativeTest-497834960-project-member Apr 11 23:10:39 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:10:39 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:10:39 user devstack@n-api.service[61860]: X-User-Id: 340848f1de07428e85af2cf660943c3e Apr 11 23:10:39 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesAdminNegativeTest-497834960-project-member Apr 11 23:10:39 user devstack@n-api.service[61860]: method: > Apr 11 23:10:39 user devstack@n-api.service[61860]: exception: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. Apr 11 23:10:39 user devstack@n-api.service[61860]: action_args: {'id': '04b926fc-370b-485a-ad51-944ba0791ebb'} Apr 11 23:10:39 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. Apr 11 23:10:39 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:10:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Returning 404 to user: Instance 04b926fc-370b-485a-ad51-944ba0791ebb could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:10:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-27fc2d64-cca3-4d51-b6ad-6e21d1aab57b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb" status: 404 len: 111 microversion: 2.1 time: 0.137718 Apr 11 23:10:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 123/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:39 2023] GET /compute/v2.1/servers/04b926fc-370b-485a-ad51-944ba0791ebb => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:39 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:39 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-118ef0b5-c364-40a6-9624-8ef6f0bc21bd tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150635 Apr 11 23:10:39 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 124/373] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:10:39 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-interface => generated 282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0495c378-b313-45ae-9438-2c19c513e9ee"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4885ac9a-1979-491d-af6a-8c0b2aa93b2f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347996 Apr 11 23:10:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 127/374] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:10:40 2023] POST /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:40 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] Creating event network-changed:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:10:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2fb61e3e-b581-4c1f-96c1-456bb86b1b43 req-45316a49-2d49-46ea-adb5-6220f9a85970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049962 Apr 11 23:10:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 124/375] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-90eb6520-b91d-403c-88e3-dd9fcfa05bda tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/ips" status: 200 len: 103 microversion: 2.1 time: 0.115815 Apr 11 23:10:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:10:41 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/ips => generated 103 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:10:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-18fca51b-d5e7-4415-9a26-9a2be30971b4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" status: 204 len: 0 microversion: 2.1 time: 0.132396 Apr 11 23:10:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:10:41 2023] DELETE /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340848f1de07428e85af2cf660943c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d77b00c084f6f857147717350b6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1b3d2f8c-70eb-437a-a7fd-7946df81b8a4 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" status: 200 len: 1670 microversion: 2.1 time: 0.216763 Apr 11 23:10:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:41 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "name": "network-vif-unplugged", "status": "completed", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] Creating event network-vif-unplugged:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:10:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-f7548f54-226b-41c7-8e76-88c5adab5e2e req-320737ad-a3a8-4570-8aae-4459da8c07e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043383 Apr 11 23:10:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75f7d204-26d3-4992-8036-0690d066ab68"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-12d9b01c-b920-4eb5-a640-a744724c4e8a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323729 Apr 11 23:10:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 129/380] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:10:42 2023] POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "name": "network-vif-deleted", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] Creating event network-vif-deleted:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:10:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-c61bedfa-19d6-4272-aa08-8bf67d526037 req-d23e471e-7243-435d-a8b1-696b9301358a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Apr 11 23:10:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3", "name": "network-vif-plugged", "status": "completed", "tag": "ac411bad-0310-4c20-946a-b95b7b3e3e16"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] Creating event network-vif-plugged:ac411bad-0310-4c20-946a-b95b7b3e3e16 for instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 on user Apr 11 23:10:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e23d42dd-5a35-4719-a5cc-9bce1f8dc535 req-c6bb1f9f-6a7e-4db3-8de8-3a6722db0962 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Apr 11 23:10:43 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-50af2db2-1c2d-44a6-80a2-ad4b568bfd4a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: .version_select at 0x7f3157cef7f0>, body: {"keypair": {"name": "tempest-keypair-871178907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBMEewzXEFy6CSMxptTsXBa5J41k9pW5kYlrexIdLtOBRh01epIt7LV7EDJlwObFzREbUoeDYDcdXxxRAjnOopOEfu8u05/8uauEotW0z7ypKiOFDNzAI9D4I71bSqQGg=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:48 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-50af2db2-1c2d-44a6-80a2-ad4b568bfd4a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:10:48 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-50af2db2-1c2d-44a6-80a2-ad4b568bfd4a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:10:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-50af2db2-1c2d-44a6-80a2-ad4b568bfd4a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050712 Apr 11 23:10:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 130/383] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:10:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1566798189", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f013a872-a4db-4d26-8b73-353db89b647e"}], "security_groups": [{"name": "tempest-securitygroup--1047302318"}], "key_name": "tempest-keypair-871178907", "user_data": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:49 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] validate_networks() for [('f013a872-a4db-4d26-8b73-353db89b647e', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:10:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8aab1d59-280d-4a3e-8d91-b6778117b817 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.696977 Apr 11 23:10:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 127/384] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:10:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d449dd50-7294-4026-9eb3-6acf608789f1 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d449dd50-7294-4026-9eb3-6acf608789f1 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-d449dd50-7294-4026-9eb3-6acf608789f1 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d449dd50-7294-4026-9eb3-6acf608789f1 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 200 len: 1235 microversion: 2.1 time: 0.074549 Apr 11 23:10:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:50 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 1235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Going to try to stop instance {{(pid=61859) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 23:10:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-57158013-1e3f-4968-be79-2637ae51261f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action" status: 202 len: 0 microversion: 2.1 time: 0.114258 Apr 11 23:10:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 131/386] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:10:50 2023] POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1bf9f06b-d4dd-44f0-b959-071608a90c48 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1709 microversion: 2.1 time: 0.183667 Apr 11 23:10:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 128/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:50 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-unplugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] Creating event network-vif-unplugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:10:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-071998ba-a44b-4eb1-93d5-c55e71fd5487 req-f5df659a-aad7-42cc-b7d8-d0f006943bb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035026 Apr 11 23:10:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] Creating event network-changed:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:10:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6811eee0-1493-4286-9385-c0565e71d759 req-a40b70ed-99e9-4f18-befa-adc3c4b31761 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 Apr 11 23:10:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 132/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:10:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-370a5128-b792-4636-b46f-87a583467c0e req-14fcfb59-e70b-484f-b86f-a4e6c4c46c1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027294 Apr 11 23:10:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 129/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "name": "network-vif-plugged", "status": "completed", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] Creating event network-vif-plugged:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:10:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3352fb38-79b6-4481-ba03-11668e4a8b6a req-d7de268a-9b3e-4eed-8aed-57757da646a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035194 Apr 11 23:10:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:56 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "name": "network-vif-plugged", "status": "completed", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:10:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:57 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:10:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] Creating event network-vif-plugged:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:10:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d53504f8-72bc-43ac-a847-28d4ddacc7df req-da8ab6e4-f30e-4954-aa36-859409c8ad23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Apr 11 23:10:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 133/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:10:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:10:59 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:10:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-02559c78-7ac8-483a-8a60-9d92081f4bb2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 200 len: 1550 microversion: 2.1 time: 0.208607 Apr 11 23:10:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 130/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:10:59 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 1550 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:00 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f2d1201d-90c1-43cd-bbbf-d396f9c4d207 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9" status: 200 len: 1497 microversion: 2.1 time: 0.163498 Apr 11 23:11:00 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 131/394] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:00 2023] GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:04 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lazy-loading 'services' on Instance uuid 4f95b120-0c70-45a5-969f-c1728c72d420 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:11:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b83cf2e2-ce57-4e2f-8da6-349ddd5369c3 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments/5d576508-63a9-4c1c-8b86-952f4522ecd4" status: 202 len: 0 microversion: 2.1 time: 0.158554 Apr 11 23:11:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:11:04 2023] DELETE /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments/5d576508-63a9-4c1c-8b86-952f4522ecd4 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0d915db0-0ce6-439f-96e5-b674dbd49352 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059183 Apr 11 23:11:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 131/396] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:11:04 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=19 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=25 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:16 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-32b8d0f9-223a-45d2-b65c-48ea78791100 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1492 microversion: 2.1 time: 0.148228 Apr 11 23:11:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:16 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1492 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-dd621614-5f7b-43db-8e44-2fe10582d43c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055405 Apr 11 23:11:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 135/398] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 23:11:20 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=33 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:11:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d6f816ee-f092-4e7d-8a5b-d2460a943e7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 204 len: 0 microversion: 2.20 time: 0.124522 Apr 11 23:11:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 132/399] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:11:20 2023] DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:20 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-aed37dc1-a870-4117-b6cf-86ee32a3a8ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 200 len: 1708 microversion: 2.20 time: 0.218080 Apr 11 23:11:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 133/400] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:11:20 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 1708 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-unplugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] Creating event network-vif-unplugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:11:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-3bfac82b-9698-4fe8-a523-248f02d4303c req-bc884acd-3615-41d2-8123-cda5cd96e635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029901 Apr 11 23:11:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 136/401] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-plugged", "status": "completed", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}, {"server_uuid": "8322b884-2831-48af-a67e-26c31c17f49f", "name": "network-vif-deleted", "tag": "b44a27e4-9811-4e81-8f41-c7f58def46bc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Creating event network-vif-plugged:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:11:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] Creating event network-vif-deleted:b44a27e4-9811-4e81-8f41-c7f58def46bc for instance 8322b884-2831-48af-a67e-26c31c17f49f on user Apr 11 23:11:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2440a9a5-b3cf-4ada-a681-0a2dba1e8ae6 req-dc961ce6-9695-442a-84c7-f6f2cf9c6abd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043647 Apr 11 23:11:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 133/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e013f26d-7deb-40df-9cbf-4a61c6549ac7"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-05064776-568b-4a3e-9779-568f8d049186 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311868 Apr 11 23:11:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 134/403] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:11:25 2023] POST /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lazy-loading 'services' on Instance uuid eed8cea5-9e5c-4467-8993-456cb3235fd8 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:11:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-50ee7dee-27d3-4395-868a-f5468ec69cc7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments/5f2d798b-8277-4bd3-a36e-dd47771c3f8d" status: 202 len: 0 microversion: 2.1 time: 0.165776 Apr 11 23:11:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 137/404] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:11:31 2023] DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments/5f2d798b-8277-4bd3-a36e-dd47771c3f8d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8f3417bc-3e06-449f-892e-e523fcea4604 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051646 Apr 11 23:11:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 134/405] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:11:31 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] [instance: fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] HTTP exception thrown: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Request method failure captured: Apr 11 23:11:31 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 HTTP/1.1 Apr 11 23:11:31 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:11:31 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:11:31 user devstack@n-api.service[61861]: Connection: close Apr 11 23:11:31 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:11:31 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:11:31 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:11:31 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:11:31 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNed5W3rc__J3pJ6x28JfihhIucPnEeC-TOKdHK4l4pXlK16lp_P_Xt5l2UQGbx7WNg8oeh9XzlSSyr7UyrpaPHWGxqm4WI28U3P8PAe5TVMoxn1dZu33ZBApH80-aHms-wtlIO-X20sovr463GYR5onCY47c4hB8AWLf7bkBBPLr8HM Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Project-Id: c24d77b00c084f6f857147717350b6e0 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c24d77b00c084f6f857147717350b6e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c24d77b00c084f6f857147717350b6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c24d77b00c084f6f857147717350b6e0"}]}] Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Tenant-Id: c24d77b00c084f6f857147717350b6e0 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-497834960 Apr 11 23:11:31 user devstack@n-api.service[61861]: X-User: tempest-VolumesAdminNegativeTest-497834960-project-member Apr 11 23:11:31 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:11:31 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:11:31 user devstack@n-api.service[61861]: X-User-Id: 340848f1de07428e85af2cf660943c3e Apr 11 23:11:31 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesAdminNegativeTest-497834960-project-member Apr 11 23:11:31 user devstack@n-api.service[61861]: method: > Apr 11 23:11:31 user devstack@n-api.service[61861]: exception: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. Apr 11 23:11:31 user devstack@n-api.service[61861]: action_args: {'id': 'fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3'} Apr 11 23:11:31 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. Apr 11 23:11:31 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:11:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Returning 404 to user: Instance fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:11:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9d2a61ec-adc5-40c8-8a02-97006522650b tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3" status: 404 len: 111 microversion: 2.1 time: 0.031545 Apr 11 23:11:31 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 135/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:31 2023] GET /compute/v2.1/servers/fe2d94fa-c24a-45ae-bd3e-83cbea34c7c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:11:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a3dac3a8-e646-4eb4-94e7-673e0ce3b322 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] Calling method '.version_select at 0x7f31579d9630>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a3dac3a8-e646-4eb4-94e7-673e0ce3b322 tempest-VolumesAdminNegativeTest-497834960 tempest-VolumesAdminNegativeTest-497834960-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401661035" status: 202 len: 0 microversion: 2.1 time: 0.025440 Apr 11 23:11:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 138/407] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:11:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401661035 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:11:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3b22da51-37cd-49ca-8b7e-f65f41b884e0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 204 len: 0 microversion: 2.1 time: 0.128115 Apr 11 23:11:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 135/408] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:11:32 2023] DELETE /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:32 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190187c84d9a42e4a6f6e2a834cae8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b607b5736495895de9c423eeb7443', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-832a160d-f3b5-47cc-bbb1-1985b99855b0 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 200 len: 1541 microversion: 2.1 time: 0.184790 Apr 11 23:11:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 136/409] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:32 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 1541 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "name": "network-vif-unplugged", "status": "completed", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] Creating event network-vif-unplugged:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:11:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-96d6bc08-ca13-4de7-b2e5-bcf77229cdd1 req-23e2ac3b-3220-4d05-8cf5-7399a0e7a5c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031710 Apr 11 23:11:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 139/410] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "name": "network-vif-deleted", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] Creating event network-vif-deleted:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:11:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-fd121bc5-1409-4a6d-b7d0-d6017bfa55e9 req-31a67503-9295-4b7d-b877-20b3ef0a105e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Apr 11 23:11:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 136/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95ec17c-3200-4f51-be89-116ee3306968", "name": "network-vif-plugged", "status": "completed", "tag": "e40ede4c-bd9e-4e65-bc15-6320fcd5134a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] Creating event network-vif-plugged:e40ede4c-bd9e-4e65-bc15-6320fcd5134a for instance a95ec17c-3200-4f51-be89-116ee3306968 on user Apr 11 23:11:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3ba192f0-8133-459c-8f39-7df46f731e40 req-1de9d528-2bae-4b3f-86ce-39b88bb66ade service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038129 Apr 11 23:11:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 137/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:40 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ccf8f22b-69cc-4d9c-85ab-3fbd3bcfffad tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 200 len: 1544 microversion: 2.1 time: 0.192798 Apr 11 23:11:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 140/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:40 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 1544 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:41 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8cefaf4a-3786-496e-b21f-4492025983f7 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1686 microversion: 2.1 time: 0.150884 Apr 11 23:11:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:40 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-477eef51-7d82-432a-aaf3-aa38f0f84a80 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065395 Apr 11 23:11:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 138/415] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:11:54 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:11:56 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-30470108-3325-4ddb-9635-7b6273fc5d59 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '.version_select at 0x7f3157805750>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:56 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:56 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-30470108-3325-4ddb-9635-7b6273fc5d59 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a" status: 204 len: 0 microversion: 2.1 time: 0.212459 Apr 11 23:11:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 141/416] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:56 2023] DELETE /compute/v2.1/images/1d98e55d-ff92-4ffd-ba89-2fe05e161b7a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:57 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:11:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7c0a9286-deb8-4727-aff9-664c2491c929 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 204 len: 0 microversion: 2.1 time: 0.123856 Apr 11 23:11:57 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 138/417] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:11:57 2023] DELETE /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:57 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e926b3053c4258a3340d19ae40a7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8550fae43fa54d9a99dedf1d8e3bf0d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:57 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5057c4ba-3445-4520-8d67-dd89120f9d22 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 200 len: 1676 microversion: 2.1 time: 0.216069 Apr 11 23:11:57 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:57 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-unplugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] Creating event network-vif-unplugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:11:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-01d141d6-5a07-4aa5-8f15-a8f19d7d417a req-6fe41142-3ab6-42ac-999b-c174bedaa04c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030245 Apr 11 23:11:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 142/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:58 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-deleted", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] Creating event network-vif-deleted:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:11:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-955c7307-2c4b-4408-a64b-4ede787eb46e req-4771ddef-aa19-482d-a5ab-8560cdc9e2dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Apr 11 23:11:58 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-af19afca-067b-41f6-8bc0-1e3cd97918ac tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 200 len: 1550 microversion: 2.1 time: 0.176160 Apr 11 23:11:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:59 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 1550 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:11:59 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f95b120-0c70-45a5-969f-c1728c72d420", "name": "network-vif-plugged", "status": "completed", "tag": "7a130357-a93e-4aad-8404-d4b5b8dd7022"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:11:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] Creating event network-vif-plugged:7a130357-a93e-4aad-8404-d4b5b8dd7022 for instance 4f95b120-0c70-45a5-969f-c1728c72d420 on user Apr 11 23:11:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-ef0f837c-a83e-4d67-ae18-0c9ab3b85dc8 req-d8903a52-262a-40b8-8fb7-1008fc58fb57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029792 Apr 11 23:11:59 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:11:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7aa614ef-35f9-4445-af23-1d9318a07d8d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 204 len: 0 microversion: 2.1 time: 0.122310 Apr 11 23:11:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:11:59 2023] DELETE /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:11:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:11:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-80253e71-5e5f-4918-84ed-01b9123082d0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 200 len: 1556 microversion: 2.1 time: 0.172921 Apr 11 23:11:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:11:59 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da42751e-6790-4d7e-be98-53a1c86968e7", "device": "/dev/vdb"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ea3076f0-6e2f-45be-a151-0d1e037cdc35 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293431 Apr 11 23:12:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 144/425] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:12:00 2023] POST /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "name": "network-vif-deleted", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] Creating event network-vif-deleted:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:12:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-69fc2d4f-22ec-4a83-a314-c0c4ee164443 req-a907d890-9d21-4939-aadf-8ccf6797f610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034999 Apr 11 23:12:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 141/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "name": "network-vif-unplugged", "status": "completed", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}, {"server_uuid": "039fb13b-89bc-493c-af37-9f261ab5c077", "name": "network-vif-plugged", "status": "completed", "tag": "05e7023b-90b4-42fb-a20d-554820d2afea"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Creating event network-vif-unplugged:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:12:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] Creating event network-vif-plugged:05e7023b-90b4-42fb-a20d-554820d2afea for instance 039fb13b-89bc-493c-af37-9f261ab5c077 on user Apr 11 23:12:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-3e531f4b-6282-4cb4-89bc-dfc54a9d0f01 req-a1d37569-db08-43ad-a593-d6c523c66a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.043487 Apr 11 23:12:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 142/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:12:10 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f HTTP/1.1 Apr 11 23:12:10 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:12:10 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:12:10 user devstack@n-api.service[61859]: Connection: close Apr 11 23:12:10 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:12:10 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:12:10 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:12:10 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:12:10 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:12:10 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:12:10 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:12:10 user devstack@n-api.service[61859]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:12:10 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:12:10 user devstack@n-api.service[61859]: method: > Apr 11 23:12:10 user devstack@n-api.service[61859]: exception: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:12:10 user devstack@n-api.service[61859]: action_args: {'id': '8322b884-2831-48af-a67e-26c31c17f49f'} Apr 11 23:12:10 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:12:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-cbb8a1e1-9a2c-4d8d-a1d0-c41592b1e9ac tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 404 len: 111 microversion: 2.20 time: 0.033875 Apr 11 23:12:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 145/428] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:12:10 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:12:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d38f444b-40b0-4a27-b69a-9fdc8a14d9f3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '.version_select at 0x7f315799a440>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d38f444b-40b0-4a27-b69a-9fdc8a14d9f3 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208393987" status: 204 len: 0 microversion: 2.20 time: 0.020462 Apr 11 23:12:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 142/429] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 23:12:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208393987 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:12:11 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-07037aca-ebfa-4b49-a2e8-736884faab7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: .version_select at 0x7f3157aa7c70>, body: {"keypair": {"name": "tempest-keypair-865048007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDui0SPuSNcW3iQQT+n8CdN0Nt1xzZAZfHsKqwSiujdTOOOEDSXAwM3wlZDgrq/pjBr0c+y+HW1Zg37Jw+CuC31UFynDxv2RaP8mEcuOy82rtfiD6ySkPqukQhekjgAg=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:11 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-07037aca-ebfa-4b49-a2e8-736884faab7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for project b466a7e141a247319eae64ab30aca760. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:12:11 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-07037aca-ebfa-4b49-a2e8-736884faab7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for user 7272af33be864737b2231127f4323638 and project b466a7e141a247319eae64ab30aca760. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:12:11 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-07037aca-ebfa-4b49-a2e8-736884faab7a tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.060051 Apr 11 23:12:11 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 143/430] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 23:12:11 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1536485804", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6af6f111-70ec-4fd4-8d8c-d05bd0886155"}], "security_groups": [{"name": "tempest-securitygroup--1654257268"}], "key_name": "tempest-keypair-865048007", "user_data": "}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] validate_networks() for [('6af6f111-70ec-4fd4-8d8c-d05bd0886155', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for project b466a7e141a247319eae64ab30aca760. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Getting quotas for user 7272af33be864737b2231127f4323638 and project b466a7e141a247319eae64ab30aca760. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:12:13 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:12:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c5f29928-21ea-4656-a640-a83f2dbbae64 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.709445 Apr 11 23:12:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 146/431] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:12:13 2023] POST /compute/v2.1/servers => generated 400 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f0734f59-4ce9-43ce-96c1-938feaa64150 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1275 microversion: 2.20 time: 0.078854 Apr 11 23:12:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 143/432] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:12:14 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1275 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=26 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'services' on Instance uuid 80d81d49-127b-4bc7-aefc-1ba1678394c9 {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:12:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2c5dd007-253f-4263-920e-7036db16f773 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9/os-volume_attachments/da42751e-6790-4d7e-be98-53a1c86968e7" status: 202 len: 0 microversion: 2.1 time: 0.177976 Apr 11 23:12:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 144/433] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:12:14 2023] DELETE /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9/os-volume_attachments/da42751e-6790-4d7e-be98-53a1c86968e7 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:12:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9ae0749a-0bdf-4d7b-8809-c3fe362c9425 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9" status: 204 len: 0 microversion: 2.1 time: 0.126995 Apr 11 23:12:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 147/434] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:12:14 2023] DELETE /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-2439448f-094d-4d81-972b-5e35dc81156e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9" status: 200 len: 1549 microversion: 2.1 time: 0.155590 Apr 11 23:12:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:14 2023] GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] Creating event network-changed:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:12:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d0135879-62bd-43ee-8a92-f33848fb80e5 req-c164c66b-712d-4a8c-8863-aa34cc916116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053969 Apr 11 23:12:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 145/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "name": "network-vif-unplugged", "status": "completed", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] Creating event network-vif-unplugged:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:12:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d42beb24-b4ea-4b28-99ec-b61654f18bc7 req-f18419dc-b453-4a0b-a06d-447668364c89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032980 Apr 11 23:12:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 148/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e9583e01-db7f-442f-b19f-a415d8513e59 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1641236990", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "destination_type": "local"}, {"source_type": "volume", "uuid": "76b614e1-3796-4a83-98e8-28772fb78210", "destination_type": "invalid"}], "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e9583e01-db7f-442f-b19f-a415d8513e59 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:12:18 user devstack@n-api.service[61860]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 23:12:18 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:18 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:18 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:18 user devstack@n-api.service[61860]: Content-Length: 494 Apr 11 23:12:18 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:18 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:18 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:18 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:12:18 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:12:18 user devstack@n-api.service[61860]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:12:18 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:18 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:18 user devstack@n-api.service[61860]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:12:18 user devstack@n-api.service[61860]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:12:18 user devstack@n-api.service[61860]: Apr 11 23:12:18 user devstack@n-api.service[61860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1641236990", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "destination_type": "local"}, {"source_type": "volume", "uuid": "76b614e1-3796-4a83-98e8-28772fb78210", "destination_type": "invalid"}], "networks": [{"uuid": "02021ebc-33d0-4630-a873-2190cd8d8360"}]}} Apr 11 23:12:18 user devstack@n-api.service[61860]: method: > Apr 11 23:12:18 user devstack@n-api.service[61860]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 23:12:18 user devstack@n-api.service[61860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1641236990', 'imageRef': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '76b614e1-3796-4a83-98e8-28772fb78210', 'destination_type': 'invalid'}], 'networks': [{'uuid': '02021ebc-33d0-4630-a873-2190cd8d8360'}]}}} Apr 11 23:12:18 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise error Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 23:12:18 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e9583e01-db7f-442f-b19f-a415d8513e59 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e9583e01-db7f-442f-b19f-a415d8513e59 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009719 Apr 11 23:12:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 145/438] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:12:18 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:18 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-925aaf61-4d96-494a-9d4c-410676945496 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1492 microversion: 2.1 time: 0.220052 Apr 11 23:12:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 146/439] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:18 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1492 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "name": "network-vif-deleted", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] Creating event network-vif-deleted:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:12:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-554b3bbe-5143-4fa9-956f-3877d4398b28 req-55b0e370-5be6-450e-9729-bb37d9de89cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034898 Apr 11 23:12:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 149/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d81d49-127b-4bc7-aefc-1ba1678394c9", "name": "network-vif-plugged", "status": "completed", "tag": "fa5e73f7-905e-4a69-bd98-a9b5dcbd6785"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] Creating event network-vif-plugged:fa5e73f7-905e-4a69-bd98-a9b5dcbd6785 for instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 on user Apr 11 23:12:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9d86d47e-b77b-4053-8d37-d3fe13238361 req-4a1d842e-9208-49e1-aaef-a0980bf31b1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Apr 11 23:12:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}, {"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:12:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:12:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ccbb5071-1767-4630-9698-b6f4d7ef890b req-ee049d27-9a61-41f2-ad07-c840760efb2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034956 Apr 11 23:12:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-af693f51-4cba-425b-ba9f-c458ef68fbe3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043922 Apr 11 23:12:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:12:21 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-722d176d-9ae2-471a-8591-8585a135de4c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1677 microversion: 2.1 time: 0.158864 Apr 11 23:12:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:21 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9bbddf49-962d-4023-8a44-69b88b51c84f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1677 microversion: 2.1 time: 0.157153 Apr 11 23:12:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:21 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3c17a0ea-cd6d-4a49-975d-a9806656e972 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1677 microversion: 2.1 time: 0.154368 Apr 11 23:12:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 151/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:22 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] HTTP exception thrown: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Request method failure captured: Apr 11 23:12:22 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 HTTP/1.1 Apr 11 23:12:22 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:22 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:22 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:22 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:12:22 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:22 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:22 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:22 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeisJ6qVqQV7k6oLvySBK40erfe2pObQ6fLVpnkkczKyq7nhAFjdZ9LsOgnP9I7uPoTs4ayYzYepAbU40zajb_2tnUHcclfH38sX2XVALE9qdngs93Z_5Ba8qTBIXk0OX-AKvHPUllqhsjNK8Ji8pauR-ztlZzHfdSEqBA3BFqxhdPs Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Project-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Project-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db2b607b5736495895de9c423eeb7443"}]}] Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Tenant: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Tenant-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61860]: X-User: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:22 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:22 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:22 user devstack@n-api.service[61860]: X-User-Id: 190187c84d9a42e4a6f6e2a834cae8eb Apr 11 23:12:22 user devstack@n-api.service[61860]: X-User-Name: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:22 user devstack@n-api.service[61860]: method: > Apr 11 23:12:22 user devstack@n-api.service[61860]: exception: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61860]: action_args: {'id': 'a95ec17c-3200-4f51-be89-116ee3306968'} Apr 11 23:12:22 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Returning 404 to user: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-31876951-6842-4f07-a2e2-e904cc409ddd tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 404 len: 111 microversion: 2.1 time: 0.053227 Apr 11 23:12:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:22 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] HTTP exception thrown: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Request method failure captured: Apr 11 23:12:22 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968/os-volume_attachments HTTP/1.1 Apr 11 23:12:22 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:12:22 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:12:22 user devstack@n-api.service[61861]: Connection: close Apr 11 23:12:22 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:12:22 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:12:22 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:12:22 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:12:22 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeisJ6qVqQV7k6oLvySBK40erfe2pObQ6fLVpnkkczKyq7nhAFjdZ9LsOgnP9I7uPoTs4ayYzYepAbU40zajb_2tnUHcclfH38sX2XVALE9qdngs93Z_5Ba8qTBIXk0OX-AKvHPUllqhsjNK8Ji8pauR-ztlZzHfdSEqBA3BFqxhdPs Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Project-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Project-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db2b607b5736495895de9c423eeb7443"}]}] Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Tenant: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Tenant-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:22 user devstack@n-api.service[61861]: X-User: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:22 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:12:22 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:12:22 user devstack@n-api.service[61861]: X-User-Id: 190187c84d9a42e4a6f6e2a834cae8eb Apr 11 23:12:22 user devstack@n-api.service[61861]: X-User-Name: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:22 user devstack@n-api.service[61861]: method: > Apr 11 23:12:22 user devstack@n-api.service[61861]: exception: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61861]: action_args: {'server_id': 'a95ec17c-3200-4f51-be89-116ee3306968'} Apr 11 23:12:22 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:22 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:12:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Returning 404 to user: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-93ca11c3-b80e-474f-9778-ff095099285d tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053764 Apr 11 23:12:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:12:22 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] HTTP exception thrown: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Request method failure captured: Apr 11 23:12:25 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 HTTP/1.1 Apr 11 23:12:25 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:12:25 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:12:25 user devstack@n-api.service[61859]: Connection: close Apr 11 23:12:25 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:12:25 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:12:25 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:12:25 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:12:25 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeisJ6qVqQV7k6oLvySBK40erfe2pObQ6fLVpnkkczKyq7nhAFjdZ9LsOgnP9I7uPoTs4ayYzYepAbU40zajb_2tnUHcclfH38sX2XVALE9qdngs93Z_5Ba8qTBIXk0OX-AKvHPUllqhsjNK8Ji8pauR-ztlZzHfdSEqBA3BFqxhdPs Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Project-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Project-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db2b607b5736495895de9c423eeb7443"}]}] Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Tenant: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Tenant-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61859]: X-User: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:25 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:12:25 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:12:25 user devstack@n-api.service[61859]: X-User-Id: 190187c84d9a42e4a6f6e2a834cae8eb Apr 11 23:12:25 user devstack@n-api.service[61859]: X-User-Name: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:25 user devstack@n-api.service[61859]: method: > Apr 11 23:12:25 user devstack@n-api.service[61859]: exception: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61859]: action_args: {'id': 'a95ec17c-3200-4f51-be89-116ee3306968'} Apr 11 23:12:25 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Returning 404 to user: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ef9d6bb0-b87b-4104-b301-c49f3e5b4b07 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 404 len: 111 microversion: 2.1 time: 0.032666 Apr 11 23:12:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 152/449] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:12:25 2023] DELETE /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] [instance: a95ec17c-3200-4f51-be89-116ee3306968] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] HTTP exception thrown: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Request method failure captured: Apr 11 23:12:25 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 HTTP/1.1 Apr 11 23:12:25 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:25 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:25 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:25 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:12:25 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:25 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:25 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:25 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeisJ6qVqQV7k6oLvySBK40erfe2pObQ6fLVpnkkczKyq7nhAFjdZ9LsOgnP9I7uPoTs4ayYzYepAbU40zajb_2tnUHcclfH38sX2XVALE9qdngs93Z_5Ba8qTBIXk0OX-AKvHPUllqhsjNK8Ji8pauR-ztlZzHfdSEqBA3BFqxhdPs Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Project-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Project-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db2b607b5736495895de9c423eeb7443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db2b607b5736495895de9c423eeb7443"}]}] Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Tenant: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Tenant-Id: db2b607b5736495895de9c423eeb7443 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854468270 Apr 11 23:12:25 user devstack@n-api.service[61860]: X-User: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:25 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:25 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:25 user devstack@n-api.service[61860]: X-User-Id: 190187c84d9a42e4a6f6e2a834cae8eb Apr 11 23:12:25 user devstack@n-api.service[61860]: X-User-Name: tempest-DeleteServersTestJSON-1854468270-project-member Apr 11 23:12:25 user devstack@n-api.service[61860]: method: > Apr 11 23:12:25 user devstack@n-api.service[61860]: exception: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61860]: action_args: {'id': 'a95ec17c-3200-4f51-be89-116ee3306968'} Apr 11 23:12:25 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. Apr 11 23:12:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] Returning 404 to user: Instance a95ec17c-3200-4f51-be89-116ee3306968 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6ef2854a-8f94-4042-998a-8157df26ebf3 tempest-DeleteServersTestJSON-1854468270 tempest-DeleteServersTestJSON-1854468270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968" status: 404 len: 111 microversion: 2.1 time: 0.028757 Apr 11 23:12:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:25 2023] GET /compute/v2.1/servers/a95ec17c-3200-4f51-be89-116ee3306968 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-3f64ced7-2897-458e-858f-396245a21aac tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.197242 Apr 11 23:12:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:12:40 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/os-interface => generated 283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Going to try to start instance {{(pid=61859) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 23:12:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6b82ad7d-3c5f-4c86-a0fe-2738c7a318d5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action" status: 202 len: 0 microversion: 2.1 time: 0.081240 Apr 11 23:12:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 153/452] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:12:41 2023] POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=18 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4844b71a-b41c-46ec-8bd3-8c595368fff8 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1695 microversion: 2.1 time: 0.156196 Apr 11 23:12:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 150/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:41 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] Creating event network-changed:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:12:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-161675fd-0635-446b-bcf3-d2a37bc5a5b0 req-3f3faa3f-6eaf-4594-8b4d-4ed24de3117b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033576 Apr 11 23:12:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 151/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-8c8eb61c-29c3-4a56-bdb6-f1ac96aadbee tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/ips" status: 200 len: 107 microversion: 2.1 time: 0.039653 Apr 11 23:12:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:12:41 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0495c378-b313-45ae-9438-2c19c513e9ee"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:12:42 user devstack@n-api.service[61860]: request: POST /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/os-volume_attachments HTTP/1.1 Apr 11 23:12:42 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:42 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:42 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:42 user devstack@n-api.service[61860]: Content-Length: 74 Apr 11 23:12:42 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:42 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:42 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:42 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:12:42 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:42 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:42 user devstack@n-api.service[61860]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:12:42 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:12:42 user devstack@n-api.service[61860]: Apr 11 23:12:42 user devstack@n-api.service[61860]: {"volumeAttachment": {"volumeId": "0495c378-b313-45ae-9438-2c19c513e9ee"}} Apr 11 23:12:42 user devstack@n-api.service[61860]: method: > Apr 11 23:12:42 user devstack@n-api.service[61860]: exception: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d Apr 11 23:12:42 user devstack@n-api.service[61860]: action_args: {'server_id': 'f2f6794f-cdcf-422e-8ae5-030fc2c3213b', 'body': {'volumeAttachment': {'volumeId': '0495c378-b313-45ae-9438-2c19c513e9ee'}}} Apr 11 23:12:42 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d Apr 11 23:12:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 400 to user: Invalid volume: volume 0495c378-b313-45ae-9438-2c19c513e9ee is already attached to instances: f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f5f639cb-60bc-4f68-aad3-af84fe069e78 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121754 Apr 11 23:12:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 151/456] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:12:42 2023] POST /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:12:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-12dec3f5-2a65-48bb-a66c-36fc2fa5e0f0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 204 len: 0 microversion: 2.1 time: 0.136441 Apr 11 23:12:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:12:42 2023] DELETE /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0110d540-3751-4005-b840-8bf04fe4ceca tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 200 len: 1550 microversion: 2.1 time: 0.192503 Apr 11 23:12:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:42 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 1550 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "name": "network-vif-unplugged", "status": "completed", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] Creating event network-vif-unplugged:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:12:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2ce7fbc1-aaa2-4103-8fe3-1f2adf443dbf req-a4b323b9-ae75-4872-b286-035d1100a7ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054021 Apr 11 23:12:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 152/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "name": "network-vif-plugged", "status": "completed", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}, {"server_uuid": "f2f6794f-cdcf-422e-8ae5-030fc2c3213b", "name": "network-vif-deleted", "tag": "9c2c207b-c711-42ef-9608-cbb701d5406f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Creating event network-vif-plugged:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:12:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] Creating event network-vif-deleted:9c2c207b-c711-42ef-9608-cbb701d5406f for instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b on user Apr 11 23:12:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-10c7bcec-6627-4901-a10a-1e74c0d91835 req-9d40d704-e02a-44dd-8abe-9aea637b5850 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032032 Apr 11 23:12:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:12:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-bffd72fe-0820-4e49-9fd1-828816e2adf7 req-4444cd1c-820b-48e7-94ff-be801d6e8415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055235 Apr 11 23:12:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 156/461] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] [instance: 4f95b120-0c70-45a5-969f-c1728c72d420] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] HTTP exception thrown: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Request method failure captured: Apr 11 23:12:47 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 HTTP/1.1 Apr 11 23:12:47 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:47 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:47 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:47 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:12:47 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:47 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:47 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:47 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeD16bbX5izNr_nwOsBRhdzxSyHBU0YvOmAOmLRGPG5hAdf04dViAODTwx1mpkGqvpDZZcLdDGoFnR8XURS-c4t15Rxa5dsbpD8YJXYL4dnWmTfBh8BJ68tam0LK9yktmB8bK-YwS80jwJk4CwC04ijEsdrZw9q9z_P9-uORydojhw Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Project-Id: 8550fae43fa54d9a99dedf1d8e3bf0d0 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerStableDeviceRescueTest-2037080891 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8550fae43fa54d9a99dedf1d8e3bf0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8550fae43fa54d9a99dedf1d8e3bf0d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8550fae43fa54d9a99dedf1d8e3bf0d0"}]}] Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerStableDeviceRescueTest-2037080891 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Tenant-Id: 8550fae43fa54d9a99dedf1d8e3bf0d0 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-2037080891 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-User: tempest-ServerStableDeviceRescueTest-2037080891-project-member Apr 11 23:12:47 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:47 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:47 user devstack@n-api.service[61860]: X-User-Id: e9e926b3053c4258a3340d19ae40a7a9 Apr 11 23:12:47 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerStableDeviceRescueTest-2037080891-project-member Apr 11 23:12:47 user devstack@n-api.service[61860]: method: > Apr 11 23:12:47 user devstack@n-api.service[61860]: exception: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. Apr 11 23:12:47 user devstack@n-api.service[61860]: action_args: {'id': '4f95b120-0c70-45a5-969f-c1728c72d420'} Apr 11 23:12:47 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. Apr 11 23:12:47 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Returning 404 to user: Instance 4f95b120-0c70-45a5-969f-c1728c72d420 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7d030693-8e99-4c03-87e5-763803aa4d85 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420" status: 404 len: 111 microversion: 2.1 time: 0.037070 Apr 11 23:12:47 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 153/462] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:47 2023] GET /compute/v2.1/servers/4f95b120-0c70-45a5-969f-c1728c72d420 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:12:47 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7893d25f-dabd-400a-ab68-c244afd860e9 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] Calling method '.version_select at 0x7f31579027a0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7893d25f-dabd-400a-ab68-c244afd860e9 tempest-ServerStableDeviceRescueTest-2037080891 tempest-ServerStableDeviceRescueTest-2037080891-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24963563" status: 202 len: 0 microversion: 2.1 time: 0.025590 Apr 11 23:12:47 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 11 23:12:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24963563 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:12:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:12:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-834f5d7f-75ba-4f4a-a59e-8b943356f41e req-3f757ec3-98ea-4b5b-bc75-9e496128fc50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038851 Apr 11 23:12:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 157/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:12:49 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 HTTP/1.1 Apr 11 23:12:49 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:12:49 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:12:49 user devstack@n-api.service[61860]: Connection: close Apr 11 23:12:49 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:12:49 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:12:49 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:12:49 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:12:49 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:12:49 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:12:49 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:12:49 user devstack@n-api.service[61860]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:12:49 user devstack@n-api.service[61860]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:12:49 user devstack@n-api.service[61860]: method: > Apr 11 23:12:49 user devstack@n-api.service[61860]: exception: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:12:49 user devstack@n-api.service[61860]: action_args: {'id': '039fb13b-89bc-493c-af37-9f261ab5c077'} Apr 11 23:12:49 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:12:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:12:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:12:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d9843477-994e-4b3d-9a2c-3a5a4d8e075f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 404 len: 111 microversion: 2.1 time: 0.037776 Apr 11 23:12:49 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 154/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:49 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1014668258", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] validate_networks() for None {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Getting quotas for project 8af76ed8ad9f4a429e346b6f8eedf895. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Getting quotas for user 6b9ffaa1f08b42ca9af5ce17a283f51b and project 8af76ed8ad9f4a429e346b6f8eedf895. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:12:51 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:12:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-eb2aa09e-de1c-410c-a93f-12f9411b2bd9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.655974 Apr 11 23:12:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 155/466] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:12:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-04cdd460-c0c6-4443-8656-0ed0a1b86fa8 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-04cdd460-c0c6-4443-8656-0ed0a1b86fa8 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-04cdd460-c0c6-4443-8656-0ed0a1b86fa8 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9ffaa1f08b42ca9af5ce17a283f51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af76ed8ad9f4a429e346b6f8eedf895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-04cdd460-c0c6-4443-8656-0ed0a1b86fa8 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" status: 200 len: 1209 microversion: 2.1 time: 0.067484 Apr 11 23:12:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 158/467] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:52 2023] GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => generated 1209 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:12:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8a690bbe-3900-42ad-97ab-86a2bdb6c473 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 204 len: 0 microversion: 2.1 time: 0.129353 Apr 11 23:12:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 155/468] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:12:52 2023] DELETE /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:52 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:12:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0af92c01-6e76-46f2-90bd-15eb188ce00d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 200 len: 1399 microversion: 2.1 time: 0.247849 Apr 11 23:12:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:12:52 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 1399 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "name": "network-vif-unplugged", "status": "completed", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] Creating event network-vif-unplugged:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:12:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d3046a2b-5125-4242-a863-7aa902242437 req-aadd97ab-75ef-4a9b-9cf8-6520a40cd560 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036061 Apr 11 23:12:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 159/470] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:12:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "name": "network-vif-deleted", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] Creating event network-vif-deleted:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:12:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-43e622ae-6a10-4d50-baca-9342f9d05c0b req-26c9bd3f-63ec-4822-aab5-31c38a11472b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Apr 11 23:12:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 156/471] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd67ca7-90b7-4881-9fb1-a1a23cc424fe", "name": "network-vif-plugged", "status": "completed", "tag": "138c5b33-78b0-4ca8-a952-7be3e230441b"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] Creating event network-vif-plugged:138c5b33-78b0-4ca8-a952-7be3e230441b for instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe on user Apr 11 23:12:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ee1e9708-3890-4008-83c6-5e842370d1d3 req-594e805a-3c56-4157-ade8-1d89e8bb5cf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055413 Apr 11 23:12:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 157/472] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:56 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:56 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:56 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] Creating event network-changed:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:12:56 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-7defe184-d2aa-47f4-9d8c-aa0f36057d6e req-d8f3629e-0af8-4d96-84c9-9805cb05fa20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030385 Apr 11 23:12:56 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 160/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:12:58 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "name": "network-vif-plugged", "status": "completed", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}, {"server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "name": "network-vif-plugged", "status": "completed", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:12:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:12:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:12:58 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:12:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Creating event network-vif-plugged:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:12:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] Creating event network-vif-plugged:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:12:58 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-f2def2c4-6b78-48ec-b22b-b99a1ae7df00 req-871070ff-37dc-4c23-8584-4daf8ea8fe3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038209 Apr 11 23:12:58 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 157/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1692522881", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:01 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] validate_networks() for [('4c17359e-31c1-483d-a0cd-920c089c1405', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:13:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for user 8d63779eda794ef0b2413ac1483f88b8 and project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:13:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-106ebf45-3695-44d5-8ef5-085a2f7627ce tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.176871 Apr 11 23:13:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 158/475] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:13:01 2023] POST /compute/v2.1/servers => generated 381 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:13:02 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ae626c2f-1658-4820-b909-c5fd57d7f692 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ae626c2f-1658-4820-b909-c5fd57d7f692 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:02 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ae626c2f-1658-4820-b909-c5fd57d7f692 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ae626c2f-1658-4820-b909-c5fd57d7f692 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1216 microversion: 2.1 time: 0.069957 Apr 11 23:13:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 161/476] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:02 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7248979", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] validate_networks() for [('4c17359e-31c1-483d-a0cd-920c089c1405', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for user 8d63779eda794ef0b2413ac1483f88b8 and project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:13:02 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:13:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-19130769-26ea-4eaf-afff-bc4f59f49297 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.533679 Apr 11 23:13:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 158/477] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:13:02 2023] POST /compute/v2.1/servers => generated 381 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e9d3d083-f6e9-4af3-9b98-38954f27fe24 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e9d3d083-f6e9-4af3-9b98-38954f27fe24 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:02 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-e9d3d083-f6e9-4af3-9b98-38954f27fe24 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e9d3d083-f6e9-4af3-9b98-38954f27fe24 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 200 len: 1213 microversion: 2.1 time: 0.065008 Apr 11 23:13:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 159/478] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:02 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-8fcd6763-c593-438e-af39-a11c1854890e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1585 microversion: 2.20 time: 0.172261 Apr 11 23:13:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 162/479] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:13:04 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1585 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 80d81d49-127b-4bc7-aefc-1ba1678394c9] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] HTTP exception thrown: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Request method failure captured: Apr 11 23:13:05 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 HTTP/1.1 Apr 11 23:13:05 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:13:05 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:13:05 user devstack@n-api.service[61860]: Connection: close Apr 11 23:13:05 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:13:05 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:13:05 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:13:05 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:13:05 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNejNwlDipH1WhwaavDf2hHXEErbAx-YEYo4a9uLHaMPY5SBH684HYjBT-FDnvY5zCtvnL4FJz-hLyv0azARvl7uf9iHz36XvxHgHTWzTCrks8ZWDUazILkNXNn9tYO1GeEMGWEg8Re6J71880TKds4u5BOBXGDYLIdKWjanzs8YFz6s Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Project-Id: 154fad18f802436d95b15503e470d942 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/154fad18f802436d95b15503e470d942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/154fad18f802436d95b15503e470d942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/154fad18f802436d95b15503e470d942"}]}] Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Tenant-Id: 154fad18f802436d95b15503e470d942 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-User: tempest-VolumesSnapshotTestJSON-76917881-project-member Apr 11 23:13:05 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:13:05 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:13:05 user devstack@n-api.service[61860]: X-User-Id: e3995d8045154666b0ae890dd3de5ef3 Apr 11 23:13:05 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesSnapshotTestJSON-76917881-project-member Apr 11 23:13:05 user devstack@n-api.service[61860]: method: > Apr 11 23:13:05 user devstack@n-api.service[61860]: exception: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. Apr 11 23:13:05 user devstack@n-api.service[61860]: action_args: {'id': '80d81d49-127b-4bc7-aefc-1ba1678394c9'} Apr 11 23:13:05 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. Apr 11 23:13:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Returning 404 to user: Instance 80d81d49-127b-4bc7-aefc-1ba1678394c9 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-26f887e6-8b97-4ccb-8c0d-6168e2ccd0b3 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9" status: 404 len: 111 microversion: 2.1 time: 0.029228 Apr 11 23:13:05 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 159/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:05 2023] GET /compute/v2.1/servers/80d81d49-127b-4bc7-aefc-1ba1678394c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:05 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:05 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:05 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] Creating event network-changed:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:13:05 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9b63e80f-9db8-4dca-a496-70afd511f69f req-6606aa6a-ecc6-469e-b548-06138c735cd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Apr 11 23:13:05 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 160/481] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] Creating event network-changed:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:13:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-e4b41b86-3707-4aa4-9413-410bae4451d2 req-4ebbefee-00a9-470f-be64-0f451f7dfd7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 Apr 11 23:13:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 163/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:13:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-dd2ceaea-81c0-4367-ad69-f57ce68e03bf req-cdf3e41f-689c-4a1a-aaff-087b87f725ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029686 Apr 11 23:13:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 160/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}, {"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:13:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:13:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-65baa4f4-d00f-4395-bfe9-98424295c79f req-32f93349-be40-405d-bc68-6e77c8b44639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038251 Apr 11 23:13:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 161/484] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-970336588", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "9d69aaba-efae-4f2d-892b-03a069468558"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] validate_networks() for [('9d69aaba-efae-4f2d-892b-03a069468558', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting quotas for project 154fad18f802436d95b15503e470d942. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Getting quotas for user e3995d8045154666b0ae890dd3de5ef3 and project 154fad18f802436d95b15503e470d942. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:13:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:13:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9fb3599d-8fe1-4d08-a12a-ce288e30f123 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.546342 Apr 11 23:13:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 164/485] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:13:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:13:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-aef0f863-f78a-4800-bda2-3cac45c27448 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:10 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-aef0f863-f78a-4800-bda2-3cac45c27448 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:10 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-aef0f863-f78a-4800-bda2-3cac45c27448 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-aef0f863-f78a-4800-bda2-3cac45c27448 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02" status: 200 len: 1212 microversion: 2.1 time: 0.061493 Apr 11 23:13:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 161/486] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:10 2023] GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 => generated 1212 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:11 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:13:11 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-90dfe316-a26e-4c7d-bc2e-b66478f9daa5 req-ed285db7-47fe-4f85-8be6-1f2741cc0d6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055570 Apr 11 23:13:11 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 162/487] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] Creating event network-changed:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:13:13 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-89af6246-74b0-4097-9608-18c133487023 req-cce449b9-5a96-45fd-b52b-96ca6969d57f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047525 Apr 11 23:13:13 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 165/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "name": "network-vif-plugged", "status": "completed", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:16 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] Creating event network-vif-plugged:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:13:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-403a7c70-a74e-43d1-8fee-c165404c2bde req-efaea758-4c78-42f0-96b6-08d2d3a46856 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Apr 11 23:13:16 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 162/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "name": "network-vif-plugged", "status": "completed", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] Creating event network-vif-plugged:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:13:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-0bc0c9ab-3077-4c07-b43d-d45320a2c5a9 req-e2cdc7cc-38fe-48cc-bbc9-df1d0478a4ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053098 Apr 11 23:13:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] HTTP exception thrown: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:13:23 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a HTTP/1.1 Apr 11 23:13:23 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:13:23 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:13:23 user devstack@n-api.service[61859]: Connection: close Apr 11 23:13:23 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:13:23 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:13:23 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:13:23 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:13:23 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:13:23 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61859]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:13:23 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:13:23 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:13:23 user devstack@n-api.service[61859]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:13:23 user devstack@n-api.service[61859]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:13:23 user devstack@n-api.service[61859]: method: > Apr 11 23:13:23 user devstack@n-api.service[61859]: exception: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61859]: action_args: {'id': '11799d90-83b6-4553-9a8f-287fdbb3cf3a'} Apr 11 23:13:23 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 404 to user: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3673b554-5b0e-420a-80be-436cb2dc766f tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 404 len: 111 microversion: 2.1 time: 0.058838 Apr 11 23:13:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:13:23 2023] DELETE /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: 11799d90-83b6-4553-9a8f-287fdbb3cf3a] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] HTTP exception thrown: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:13:23 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a HTTP/1.1 Apr 11 23:13:23 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:13:23 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:13:23 user devstack@n-api.service[61860]: Connection: close Apr 11 23:13:23 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:13:23 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:13:23 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:13:23 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:13:23 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:13:23 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:13:23 user devstack@n-api.service[61860]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:13:23 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:13:23 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:13:23 user devstack@n-api.service[61860]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:13:23 user devstack@n-api.service[61860]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:13:23 user devstack@n-api.service[61860]: method: > Apr 11 23:13:23 user devstack@n-api.service[61860]: exception: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61860]: action_args: {'id': '11799d90-83b6-4553-9a8f-287fdbb3cf3a'} Apr 11 23:13:23 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. Apr 11 23:13:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 404 to user: Instance 11799d90-83b6-4553-9a8f-287fdbb3cf3a could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e82d956f-2d4e-417f-ad17-e6eb8433cec4 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a" status: 404 len: 111 microversion: 2.1 time: 0.058036 Apr 11 23:13:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 163/492] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:23 2023] GET /compute/v2.1/servers/11799d90-83b6-4553-9a8f-287fdbb3cf3a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:13:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4ea35d6f-36c2-4889-9c47-b5c286a4fa86 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 204 len: 0 microversion: 2.1 time: 0.203439 Apr 11 23:13:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 164/493] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:13:23 2023] DELETE /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "name": "network-vif-unplugged", "status": "completed", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859ae6c19707455ebf82bf532c9e10c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3e11fd040149dd8f5a130a9682a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-30c3e4c7-6856-40dc-a8e6-a44083c9a332 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 200 len: 1498 microversion: 2.1 time: 0.322913 Apr 11 23:13:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 167/494] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:23 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] Creating event network-vif-unplugged:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:13:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-884bca4a-11fa-4037-9d4a-b189c939d27e req-cf44e1b4-3c69-4756-98b1-46fea046f370 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051559 Apr 11 23:13:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 164/495] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:24 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-513c0762-dce0-4e22-a24d-2ff5e1ca0ba7 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1677 microversion: 2.1 time: 0.276952 Apr 11 23:13:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:23 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc3f3e9-087d-4fc0-a462-78564949fef5"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-dc8498e5-209c-4763-b783-94688ce4ca6d tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374894 Apr 11 23:13:24 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 168/497] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:13:24 2023] POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "name": "network-vif-deleted", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] Creating event network-vif-deleted:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:13:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-aef8e136-3be8-47a5-a9c8-4d96c9903a49 req-b9214386-f85c-4c5e-8b9b-5ade8fcbc265 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054543 Apr 11 23:13:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 165/498] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede8a4b9-1d26-4090-a968-a90bdd5fc2c9", "name": "network-vif-plugged", "status": "completed", "tag": "d32a4080-99bc-415f-8ab8-27b11a4658b4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] Creating event network-vif-plugged:d32a4080-99bc-415f-8ab8-27b11a4658b4 for instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 on user Apr 11 23:13:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-8cd7dcb7-f108-4406-9436-c3dada6708cc req-5fe3951e-1a72-4ac0-86a3-67df6562415b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029189 Apr 11 23:13:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 166/499] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:31 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-28052fa6-426e-4cb2-a47a-1be44af92707 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1699 microversion: 2.1 time: 0.159116 Apr 11 23:13:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 169/500] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:31 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Old instance type m1.nano, new instance type m1.micro {{(pid=61860) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:13:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b1a417c4-9887-4e4f-8e87-dc40672ad4d4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action" status: 202 len: 0 microversion: 2.1 time: 0.275114 Apr 11 23:13:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 166/501] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:13:32 2023] POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:13:32 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b HTTP/1.1 Apr 11 23:13:32 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:13:32 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:13:32 user devstack@n-api.service[61859]: Connection: close Apr 11 23:13:32 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:13:32 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:13:32 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:13:32 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:13:32 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:13:32 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:13:32 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:13:32 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:13:32 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:13:32 user devstack@n-api.service[61859]: method: > Apr 11 23:13:32 user devstack@n-api.service[61859]: exception: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:13:32 user devstack@n-api.service[61859]: action_args: {'id': 'f2f6794f-cdcf-422e-8ae5-030fc2c3213b'} Apr 11 23:13:32 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:13:32 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d4fd0fab-74ba-42fa-bfc3-c8ca21ef3a05 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 404 len: 111 microversion: 2.1 time: 0.038652 Apr 11 23:13:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 170/502] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:32 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b41d51b0-26ec-48ab-89dc-2c4272c3cddb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '.version_select at 0x7f3157999e10>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b41d51b0-26ec-48ab-89dc-2c4272c3cddb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871178907" status: 202 len: 0 microversion: 2.1 time: 0.020941 Apr 11 23:13:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 167/503] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 23:13:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871178907 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:13:32 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-ce1089fe-fbac-4b9b-8709-0b36cd89c063 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1732 microversion: 2.1 time: 0.165584 Apr 11 23:13:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 167/504] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:32 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:33 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'services' on Instance uuid f2a79a44-800e-4142-b778-aae06a5c779d {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:13:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b84eda67-2ed0-4a5b-a5d2-2a5f475f9945 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments/0495c378-b313-45ae-9438-2c19c513e9ee" status: 202 len: 0 microversion: 2.1 time: 0.189017 Apr 11 23:13:33 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 171/505] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:13:33 2023] DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments/0495c378-b313-45ae-9438-2c19c513e9ee => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5a57ecdf-2b9c-49a5-876d-c7c01abbde8c tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053216 Apr 11 23:13:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 168/506] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:13:33 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Creating event network-vif-unplugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:13:34 user devstack@n-api.service[61861]: DEBUG nova.compute.api [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:13:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-2d7bab44-0927-4025-b5a3-2b66e5a788a0 req-5ce8870e-38f2-45b7-bd04-240a17465722 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065905 Apr 11 23:13:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 168/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:13:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:13:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-4bdcbfc3-ae44-48cd-a3a8-6b2bfb48b960 req-35ed90bf-0376-41cc-85d9-3953b4e4eb32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049695 Apr 11 23:13:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 172/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9ffaa1f08b42ca9af5ce17a283f51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af76ed8ad9f4a429e346b6f8eedf895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e487dbe1-adb7-4118-96e8-4fa22b4900d9 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" status: 200 len: 1455 microversion: 2.1 time: 0.160023 Apr 11 23:13:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 169/509] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:42 2023] GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:13:42 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe HTTP/1.1 Apr 11 23:13:42 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:13:42 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:13:42 user devstack@n-api.service[61861]: Connection: close Apr 11 23:13:42 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:13:42 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:13:42 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:13:42 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:13:42 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61861]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:13:42 user devstack@n-api.service[61861]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61861]: method: > Apr 11 23:13:42 user devstack@n-api.service[61861]: exception: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:42 user devstack@n-api.service[61861]: action_args: {'id': '2bd67ca7-90b7-4881-9fb1-a1a23cc424fe'} Apr 11 23:13:42 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-679755c7-9631-477a-9717-95d64a9015c5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 404 len: 111 microversion: 2.1 time: 0.033490 Apr 11 23:13:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 169/510] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:42 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:13:42 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 HTTP/1.1 Apr 11 23:13:42 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:13:42 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:13:42 user devstack@n-api.service[61859]: Connection: close Apr 11 23:13:42 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:13:42 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:13:42 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:13:42 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:13:42 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:13:42 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61859]: method: > Apr 11 23:13:42 user devstack@n-api.service[61859]: exception: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61859]: action_args: {'id': '039fb13b-89bc-493c-af37-9f261ab5c077'} Apr 11 23:13:42 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4a456ca6-601d-4628-b785-9766ef534f4d tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 404 len: 111 microversion: 2.1 time: 0.028436 Apr 11 23:13:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 173/511] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:13:42 2023] DELETE /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 039fb13b-89bc-493c-af37-9f261ab5c077] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:13:42 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 HTTP/1.1 Apr 11 23:13:42 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:13:42 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:13:42 user devstack@n-api.service[61860]: Connection: close Apr 11 23:13:42 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:13:42 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:13:42 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:13:42 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:13:42 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:13:42 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:13:42 user devstack@n-api.service[61860]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:13:42 user devstack@n-api.service[61860]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:42 user devstack@n-api.service[61860]: method: > Apr 11 23:13:42 user devstack@n-api.service[61860]: exception: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61860]: action_args: {'id': '039fb13b-89bc-493c-af37-9f261ab5c077'} Apr 11 23:13:42 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. Apr 11 23:13:42 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:13:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 039fb13b-89bc-493c-af37-9f261ab5c077 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ecd875ab-56e5-40aa-a9df-d570e5b008d1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077" status: 404 len: 111 microversion: 2.1 time: 0.028208 Apr 11 23:13:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:42 2023] GET /compute/v2.1/servers/039fb13b-89bc-493c-af37-9f261ab5c077 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:13:43 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe HTTP/1.1 Apr 11 23:13:43 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:13:43 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:13:43 user devstack@n-api.service[61861]: Connection: close Apr 11 23:13:43 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:13:43 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:13:43 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:13:43 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:13:43 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:43 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:13:43 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:13:43 user devstack@n-api.service[61861]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:13:43 user devstack@n-api.service[61861]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:43 user devstack@n-api.service[61861]: method: > Apr 11 23:13:43 user devstack@n-api.service[61861]: exception: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61861]: action_args: {'id': '2bd67ca7-90b7-4881-9fb1-a1a23cc424fe'} Apr 11 23:13:43 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-059278cf-feb8-493f-828d-5b05ce09192f tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 404 len: 111 microversion: 2.1 time: 0.026991 Apr 11 23:13:43 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 170/513] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:13:43 2023] DELETE /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:13:43 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe HTTP/1.1 Apr 11 23:13:43 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:13:43 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:13:43 user devstack@n-api.service[61859]: Connection: close Apr 11 23:13:43 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:13:43 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:13:43 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:13:43 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:13:43 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:43 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:13:43 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:13:43 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:13:43 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:13:43 user devstack@n-api.service[61859]: method: > Apr 11 23:13:43 user devstack@n-api.service[61859]: exception: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61859]: action_args: {'id': '2bd67ca7-90b7-4881-9fb1-a1a23cc424fe'} Apr 11 23:13:43 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. Apr 11 23:13:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:13:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 2bd67ca7-90b7-4881-9fb1-a1a23cc424fe could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:13:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7cfe5a3e-d4ec-469d-818f-4055cb4d6407 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe" status: 404 len: 111 microversion: 2.1 time: 0.031197 Apr 11 23:13:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 174/514] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:43 2023] GET /compute/v2.1/servers/2bd67ca7-90b7-4881-9fb1-a1a23cc424fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:13:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f639829d-47e0-433b-996e-1dc53db1d808 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: .version_select at 0x7f31579f3d00>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-15540354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTeA7e6j/wrChwM1jogClH0JWZ33jOggStHh7lL1aQsrNXULlUHFl3iqjE9etghhRnMsyLyd4JqIILvNvoCcqVmiQ5foShdj8Q9wa2sI4sRIJCvJ4hRZ+cCGZXsMJkWw=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:43 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-f639829d-47e0-433b-996e-1dc53db1d808 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:43 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-f639829d-47e0-433b-996e-1dc53db1d808 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f639829d-47e0-433b-996e-1dc53db1d808 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.044804 Apr 11 23:13:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 171/515] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:13:43 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:45 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:45 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:13:45 user devstack@n-api.service[61861]: DEBUG nova.compute.api [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:13:45 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e6152b76-c528-4a39-9e8b-d61344c6d275 req-018f3009-01e5-4165-9023-1295bead8659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048860 Apr 11 23:13:45 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 171/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-645887436", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-15540354", "security_groups": [{"name": "tempest-secgroup-smoke-1886511384"}], "block_device_mapping_v2": [{"uuid": "6170821e-16c7-4cae-a138-dbac84aea6cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=20 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:13:47 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6170821e-16c7-4cae-a138-dbac84aea6cd',volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:13:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:47 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-75439b30-0b35-48cc-a7d5-af036c9fd673 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.697194 Apr 11 23:13:47 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 175/517] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:13:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:13:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:13:47 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-655f86b0-51aa-4376-97ad-a5f4ee90bf8e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:47 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-655f86b0-51aa-4376-97ad-a5f4ee90bf8e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:47 user devstack@n-api.service[61860]: DEBUG nova.compute.api [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:13:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-23d0690c-9392-4de0-9f04-75849583d095 req-ac8cf75c-328d-4aa7-90a8-3a4b366ac9ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052237 Apr 11 23:13:47 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 172/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:48 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-655f86b0-51aa-4376-97ad-a5f4ee90bf8e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:48 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-655f86b0-51aa-4376-97ad-a5f4ee90bf8e tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 200 len: 1087 microversion: 2.1 time: 0.088423 Apr 11 23:13:48 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 172/519] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:47 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 1087 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] Creating event network-changed:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:13:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6ef49822-8849-418a-85df-67c0946fc13f req-84542f2a-4c34-49c1-b04f-615cebf25c69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 Apr 11 23:13:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 176/520] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:13:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-00511725-367e-4ff1-9d34-ceac96d3cd80 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 200 len: 1501 microversion: 2.1 time: 0.175242 Apr 11 23:13:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 173/521] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:13:53 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:13:56 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "name": "network-vif-plugged", "status": "completed", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:56 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] Creating event network-vif-plugged:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:13:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-869a9307-e085-473f-bb07-743087fa497d req-a7c5d01d-563f-4f82-86ac-68d3ba2a7aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060804 Apr 11 23:13:56 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 173/522] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "name": "network-vif-plugged", "status": "completed", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:13:58 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:13:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] Creating event network-vif-plugged:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:13:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-1c95a270-f7dc-435b-bab1-f6f4cc902fd4 req-8411ef24-bd88-4818-b801-79d2032ff2cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060336 Apr 11 23:13:58 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 177/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:13:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:01 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8e9f3e87-fa2d-44ae-a0ec-6bce4f9fc525 tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02" status: 200 len: 1495 microversion: 2.1 time: 0.242945 Apr 11 23:14:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 174/524] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:00 2023] GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 => generated 1495 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-897f05b0-a373-442c-b290-a7107f8c34c8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.140393 Apr 11 23:14:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 174/525] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 23:14:04 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-interface => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:14:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] Creating event network-changed:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:14:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-46352376-68bc-4999-925e-4c854a235308 req-e2cec39b-43a4-4756-ba2f-f296c6d5fdeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032557 Apr 11 23:14:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 178/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3a15966c-95d5-447c-a776-9b48a628b1ed tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/ips" status: 200 len: 108 microversion: 2.20 time: 0.038876 Apr 11 23:14:05 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 175/527] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 23:14:05 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:06 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lazy-loading 'flavor' on Instance uuid fab7f71b-57f6-415b-9d2d-262a8ec6cb03 {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:14:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c71d5616-9721-492e-a80f-31790f5a1f39 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/action" status: 202 len: 0 microversion: 2.20 time: 0.869774 Apr 11 23:14:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 175/528] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:14:06 2023] POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:07 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b2ff7d75-ed84-45f0-b50c-8d03f9d8337b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1710 microversion: 2.20 time: 0.199263 Apr 11 23:14:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 179/529] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:14:07 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1710 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:14:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] Creating event network-vif-unplugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:14:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-f6a57f4e-c447-4a2d-87c2-1194c1d79d62 req-9f85a48d-d10c-4d30-a307-496196877a1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038602 Apr 11 23:14:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 176/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:10 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:14:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-570e98a5-a4ec-4309-824f-4a977f2d0336 req-75e172fc-bf41-4844-9a00-3aac092549cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031879 Apr 11 23:14:10 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 176/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] Creating event network-changed:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:14:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-3825a764-d3f0-4f66-b3f1-f5297652f61e req-32bcd115-6f9d-4412-8860-c6daadb6d76e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030126 Apr 11 23:14:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 180/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] [instance: ede8a4b9-1d26-4090-a968-a90bdd5fc2c9] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] HTTP exception thrown: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Request method failure captured: Apr 11 23:14:13 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 HTTP/1.1 Apr 11 23:14:13 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:14:13 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:14:13 user devstack@n-api.service[61860]: Connection: close Apr 11 23:14:13 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:14:13 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:14:13 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:14:13 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:14:13 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeGVLNXP1dLpIsQmfKhzWmOaCxApIRV4Yjn0qE-N8-UxSlKvriaKGtsDvHNrPhCeNdu4__N34BdimFLpClkhn-0H6bS-by-0KrDg8rpmKh7m45k6YIMb3BmD_Q05AyWox8Bh0_N2FP7ePIkupwSGQKe9IlUEv6Nqia_yOEjNam-3sQ Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Project-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3e11fd040149dd8f5a130a9682a59c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3e11fd040149dd8f5a130a9682a59c"}]}] Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Tenant: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Tenant-Id: 4c3e11fd040149dd8f5a130a9682a59c Apr 11 23:14:13 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1318055293 Apr 11 23:14:13 user devstack@n-api.service[61860]: X-User: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:14:13 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:14:13 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:14:13 user devstack@n-api.service[61860]: X-User-Id: 859ae6c19707455ebf82bf532c9e10c0 Apr 11 23:14:13 user devstack@n-api.service[61860]: X-User-Name: tempest-ServersNegativeTestJSON-1318055293-project-member Apr 11 23:14:13 user devstack@n-api.service[61860]: method: > Apr 11 23:14:13 user devstack@n-api.service[61860]: exception: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. Apr 11 23:14:13 user devstack@n-api.service[61860]: action_args: {'id': 'ede8a4b9-1d26-4090-a968-a90bdd5fc2c9'} Apr 11 23:14:13 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. Apr 11 23:14:13 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:14:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] Returning 404 to user: Instance ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:14:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-57a24f9f-4f40-4715-8800-02450b798116 tempest-ServersNegativeTestJSON-1318055293 tempest-ServersNegativeTestJSON-1318055293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9" status: 404 len: 111 microversion: 2.1 time: 0.030811 Apr 11 23:14:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 177/533] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:13 2023] GET /compute/v2.1/servers/ede8a4b9-1d26-4090-a968-a90bdd5fc2c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:14:19 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-74d80e77-5355-4508-82a4-d6c6193b6637 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f3157903250>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-74d80e77-5355-4508-82a4-d6c6193b6637 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/79e18bd9-e344-4eb9-9c1f-e794d3fbe101" status: 200 len: 351 microversion: 2.1 time: 0.050874 Apr 11 23:14:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 177/534] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:14:19 2023] GET /compute/v2.1/os-volumes/79e18bd9-e344-4eb9-9c1f-e794d3fbe101 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fa83042b-9fb0-4c69-a78a-6dd81e191c18 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f315785c0d0>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fa83042b-9fb0-4c69-a78a-6dd81e191c18 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0a1f4d9a-abf0-44ab-a07c-e46e21d02bf1" status: 200 len: 351 microversion: 2.1 time: 0.051668 Apr 11 23:14:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 181/535] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:14:20 2023] GET /compute/v2.1/os-volumes/0a1f4d9a-abf0-44ab-a07c-e46e21d02bf1 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-47260beb-1fd1-4bdf-98bd-f297764f079c tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31577283a0>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-47260beb-1fd1-4bdf-98bd-f297764f079c tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/51615481-aa39-444a-ac3f-fe673ad08e3e" status: 200 len: 351 microversion: 2.1 time: 0.195911 Apr 11 23:14:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:14:21 2023] GET /compute/v2.1/os-volumes/51615481-aa39-444a-ac3f-fe673ad08e3e => generated 351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-100e517e-7249-4ae3-aa09-6c4c5740499a tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31347e6320>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=17 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-100e517e-7249-4ae3-aa09-6c4c5740499a tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.137229 Apr 11 23:14:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 178/537] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-022dd6ac-8099-40b6-a66c-13ffab4592e4 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31578f5000>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=11 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-022dd6ac-8099-40b6-a66c-13ffab4592e4 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085603 Apr 11 23:14:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 182/538] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0ab4ff9d-e19c-4aad-b1c8-0a2d69927d60 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f3157608b80>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0ab4ff9d-e19c-4aad-b1c8-0a2d69927d60 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.174369 Apr 11 23:14:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c90166db-7247-42c7-b2c0-a79102593236 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f3157954af0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c90166db-7247-42c7-b2c0-a79102593236 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.126221 Apr 11 23:14:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 179/540] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f503510f-994d-4c9f-9cd0-4f28a1090292 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f3157804ee0>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f503510f-994d-4c9f-9cd0-4f28a1090292 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.123313 Apr 11 23:14:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 183/541] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f0501ae5-8800-4817-8208-2ab682e3957d tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31347e5d80>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:22 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-026ccfff-3b9b-4f55-a90b-383b80016b18 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1731 microversion: 2.1 time: 0.216928 Apr 11 23:14:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f0501ae5-8800-4817-8208-2ab682e3957d tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.109656 Apr 11 23:14:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 180/543] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6d4be1d8-e7fe-41fe-ace8-ddc374b10899 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31578f4c10>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6d4be1d8-e7fe-41fe-ace8-ddc374b10899 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100454 Apr 11 23:14:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 184/544] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 23:14:22 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c0da013c-cd18-418e-8fd2-16299a78a4c1 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] Calling method '.version_select at 0x7f31578ab7f0>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c0da013c-cd18-418e-8fd2-16299a78a4c1 tempest-VolumesTestJSON-2146285146 tempest-VolumesTestJSON-2146285146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089764 Apr 11 23:14:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 181/545] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 23:14:23 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7d5d3a87-5128-4014-a3aa-42fa591b1b44 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.237746 Apr 11 23:14:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 181/546] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:14:23 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d/os-volume_attachments => generated 25 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:14:24 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e1a45936-ef97-474b-ae4e-b6c5037bbf48 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 204 len: 0 microversion: 2.1 time: 0.120921 Apr 11 23:14:24 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 185/547] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:14:23 2023] DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:24 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-511c4790-23cf-4877-bf05-1323bb8cdaa0 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 200 len: 1667 microversion: 2.1 time: 0.203362 Apr 11 23:14:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 182/548] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:24 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "name": "network-vif-unplugged", "status": "completed", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] Creating event network-vif-unplugged:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:14:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-387d3a9f-1dc2-4b39-a029-fb719cd272da req-1a16913a-9e3b-4d0f-8fa6-029c473d24b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034734 Apr 11 23:14:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 182/549] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "name": "network-vif-deleted", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] Creating event network-vif-deleted:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:14:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-bb7b8c2c-3610-4f41-87da-b3558f75f7ad req-897e34db-41d7-45ff-bc0f-1ffb8d21d370 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031815 Apr 11 23:14:26 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 186/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a79a44-800e-4142-b778-aae06a5c779d", "name": "network-vif-plugged", "status": "completed", "tag": "970d841b-bbfc-409e-8ec5-ddbea8be8c5d"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] Creating event network-vif-plugged:970d841b-bbfc-409e-8ec5-ddbea8be8c5d for instance f2a79a44-800e-4142-b778-aae06a5c779d on user Apr 11 23:14:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-6e3fdb42-8609-4bed-a9b0-c83e4558c580 req-ced2fbe4-b561-44d7-8f51-6d8f279a9300 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027047 Apr 11 23:14:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:32 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'services' on Instance uuid e4d31874-4273-48bc-8811-89832d18b893 {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:14:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4d42a4ee-cc4f-489f-bfc6-a3cf60c5f669 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments/75f7d204-26d3-4992-8036-0690d066ab68" status: 202 len: 0 microversion: 2.1 time: 0.474266 Apr 11 23:14:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 183/552] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:14:31 2023] DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments/75f7d204-26d3-4992-8036-0690d066ab68 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:14:34 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:34 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Going to try to stop instance {{(pid=61859) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 23:14:34 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-813c37f8-bd6a-4e1b-b493-45545f08bc93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action" status: 202 len: 0 microversion: 2.1 time: 0.078686 Apr 11 23:14:34 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 187/553] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:14:34 2023] POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=14 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=30 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:34 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:34 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ffef9d48-95dd-4145-b371-5144e94b5dec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1663 microversion: 2.1 time: 0.182313 Apr 11 23:14:34 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:34 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-unplugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] Creating event network-vif-unplugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:14:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c1f719b0-6278-49b5-a7d1-ee15f156fe5c req-b67ff609-56fe-4e10-9cf9-7bbefe4e0f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030923 Apr 11 23:14:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 184/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:14:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-ed55f118-438a-4ef5-83f5-d82ac167ece5 req-82e3e4d7-d59b-4016-8af8-b19fc359dac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Apr 11 23:14:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 188/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:38 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0840b725-d3ed-404b-ba5e-9a02ead89a74 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 200 len: 1440 microversion: 2.1 time: 0.458454 Apr 11 23:14:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 185/557] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:38 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 1440 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:14:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-84435787-b468-481c-a46c-8966676975c4 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" status: 204 len: 0 microversion: 2.1 time: 0.116943 Apr 11 23:14:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 185/558] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:14:42 2023] DELETE /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "name": "network-vif-unplugged", "status": "completed", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] Creating event network-vif-unplugged:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:14:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-4d23b4aa-ac13-4f10-94c1-5d74e4a5ee39 req-fcceb35a-1877-4715-9255-bdeaa60933a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027992 Apr 11 23:14:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 186/559] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:42 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9ffaa1f08b42ca9af5ce17a283f51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af76ed8ad9f4a429e346b6f8eedf895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:42 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f6362261-b3dd-4ea7-ab14-da93f4e98bdb tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" status: 200 len: 1461 microversion: 2.1 time: 0.354488 Apr 11 23:14:42 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 189/560] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:42 2023] GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => generated 1461 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "name": "network-vif-plugged", "status": "completed", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}, {"server_uuid": "f1767c12-a304-4d8c-a8bf-06e2bfa3aa59", "name": "network-vif-deleted", "tag": "a88122ee-01e7-411d-9ce2-2e8265b5aba5"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Creating event network-vif-plugged:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:14:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] Creating event network-vif-deleted:a88122ee-01e7-411d-9ce2-2e8265b5aba5 for instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 on user Apr 11 23:14:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-62de30d1-cb2c-42a4-a694-87e843c54144 req-62f0f3af-5778-421d-adc7-b59c0a32b88b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035792 Apr 11 23:14:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 186/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=5 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=13 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:53 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 61204bbb-04fb-4545-ade1-5665c733c5bd {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:14:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9ed20f12-9809-46b0-ba8e-d4a522596989 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd/action" status: 200 len: 32 microversion: 2.1 time: 0.113499 Apr 11 23:14:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 187/562] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:14:53 2023] POST /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:53 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ea5d5454-fabb-4e53-8a48-95247450b592 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 200 len: 1507 microversion: 2.1 time: 0.172935 Apr 11 23:14:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 190/563] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:14:53 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:14:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] Creating event network-vif-unplugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:14:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d9ebcbc3-7f58-4748-9588-3f1f2b9d1ab8 req-4f94f110-246b-4885-949d-70467cdca188 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046385 Apr 11 23:14:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 187/564] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:14:56 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:14:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-8bf3c47e-1a7a-45df-bd79-4941a4ee60a6 req-437d83fe-c2bd-4834-abd7-2a58b28e8704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037825 Apr 11 23:14:56 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 188/565] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:58 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:14:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7d68b00e-1489-49aa-942a-092426067fc9 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1651 microversion: 2.20 time: 0.170777 Apr 11 23:14:58 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 191/566] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:14:58 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1651 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:14:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}, {"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:14:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:14:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:14:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:14:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:14:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:14:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-7494cf5b-1b47-4305-81a6-461ae50e4ff1 req-ee19e4c1-a775-4c34-9b53-f0d85ae27b16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035983 Apr 11 23:14:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 188/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:14:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "340f7fcf-e01d-4c44-81c4-4dae8065c28d", "device": "/dev/vdb"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4a37d7e4-ea95-4576-a543-9ebb8c3dfb8c tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "POST /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277117 Apr 11 23:15:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 189/568] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:15:01 2023] POST /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=12 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:13 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lazy-loading 'services' on Instance uuid 410941af-9184-44ae-b416-b2a265c24f02 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:15:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e3a7b5e0-64ab-47a0-91e5-52bc302cef7e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02/os-volume_attachments/340f7fcf-e01d-4c44-81c4-4dae8065c28d" status: 202 len: 0 microversion: 2.1 time: 0.180864 Apr 11 23:15:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 192/569] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:15:13 2023] DELETE /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02/os-volume_attachments/340f7fcf-e01d-4c44-81c4-4dae8065c28d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:15:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-06d02001-722b-4b1d-98c8-92f90e21746e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02" status: 204 len: 0 microversion: 2.1 time: 0.130497 Apr 11 23:15:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:15:14 2023] DELETE /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:15:14 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d HTTP/1.1 Apr 11 23:15:14 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:15:14 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:15:14 user devstack@n-api.service[61859]: Connection: close Apr 11 23:15:14 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:15:14 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:15:14 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:15:14 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:15:14 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:15:14 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:15:14 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:15:14 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:15:14 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:15:14 user devstack@n-api.service[61859]: method: > Apr 11 23:15:14 user devstack@n-api.service[61859]: exception: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:15:14 user devstack@n-api.service[61859]: action_args: {'id': 'f2a79a44-800e-4142-b778-aae06a5c779d'} Apr 11 23:15:14 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:15:14 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:15:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:15:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b248f3fa-b841-4e68-8b6a-9870a961b63f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 404 len: 111 microversion: 2.1 time: 0.029984 Apr 11 23:15:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 193/571] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:14 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:15:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-30dcd0a3-d7dd-42ac-9623-c056ca5a9698 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '.version_select at 0x7f3157901ab0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-30dcd0a3-d7dd-42ac-9623-c056ca5a9698 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101679830" status: 202 len: 0 microversion: 2.1 time: 0.021574 Apr 11 23:15:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 190/572] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:15:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101679830 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:15:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3995d8045154666b0ae890dd3de5ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154fad18f802436d95b15503e470d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c8a29dc7-3360-42a8-822d-7fb606005b1e tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02" status: 200 len: 1547 microversion: 2.1 time: 0.161640 Apr 11 23:15:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:14 2023] GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6b2f8d3d-be62-4087-bf95-a9652b4617ef tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: .version_select at 0x7f31578055a0>, body: {"keypair": {"name": "tempest-keypair-357942564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqiBFzmneB80tP6Tj+qnl3+1eC133Qn4aI89AQCOP2iFxgPQXn34wxavPyq4/G//gf7atdxb0KzJCdIbFr2aiqBtboY8aU8MocAETUKCiEdjsmvXRKyD49TLOFZwfjIOg=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:15 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-6b2f8d3d-be62-4087-bf95-a9652b4617ef tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:15:15 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-6b2f8d3d-be62-4087-bf95-a9652b4617ef tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:15:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6b2f8d3d-be62-4087-bf95-a9652b4617ef tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063994 Apr 11 23:15:15 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 194/574] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:15:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "name": "network-vif-unplugged", "status": "completed", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] Creating event network-vif-unplugged:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:15:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-80befde0-c287-460f-bcb6-0fd0aeb28d80 req-25411090-ad3b-4ae6-aae2-43d4a6a50565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027947 Apr 11 23:15:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 191/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:16 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-131271423", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f013a872-a4db-4d26-8b73-353db89b647e"}], "security_groups": [{"name": "tempest-securitygroup--1559618838"}], "key_name": "tempest-keypair-357942564", "user_data": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:16 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] validate_networks() for [('f013a872-a4db-4d26-8b73-353db89b647e', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:15:17 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:15:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7a5a8868-2530-4fc6-9620-6535c2f57aed tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.675970 Apr 11 23:15:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 191/576] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:15:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:15:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fa284572-76c8-4f33-9128-eea4acf5180f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:17 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fa284572-76c8-4f33-9128-eea4acf5180f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:17 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-fa284572-76c8-4f33-9128-eea4acf5180f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fa284572-76c8-4f33-9128-eea4acf5180f tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 200 len: 1234 microversion: 2.1 time: 0.073072 Apr 11 23:15:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 195/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:17 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 1234 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "name": "network-vif-deleted", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] Creating event network-vif-deleted:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:15:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c60f52b9-14d3-4300-9819-241bb99db6e2 req-d3cde9c0-aa30-4757-8bff-50a8dfde0988 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086869 Apr 11 23:15:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410941af-9184-44ae-b416-b2a265c24f02", "name": "network-vif-plugged", "status": "completed", "tag": "ad12511e-bbda-4cfd-9ea9-093053aedb3e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] Creating event network-vif-plugged:ad12511e-bbda-4cfd-9ea9-093053aedb3e for instance 410941af-9184-44ae-b416-b2a265c24f02 on user Apr 11 23:15:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-246b0ca3-e7a3-4e9b-8d20-41201399e42c req-c6eaef37-f1ed-46ab-b13d-24a639579bd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Apr 11 23:15:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 192/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] Creating event network-changed:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:15:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b3f14120-24b1-45ac-9d11-b1dead592ab4 req-ee1bec00-bf03-4369-8b5d-383610cf9ddd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038463 Apr 11 23:15:19 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 196/580] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "name": "network-vif-plugged", "status": "completed", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] Creating event network-vif-plugged:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:15:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-a18e8c41-504c-48a7-a556-2d4f52ef1f4d req-35e89380-753d-4fc8-9128-935d17235875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037838 Apr 11 23:15:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-21521d9a-a163-4564-8239-294878892936 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action" status: 202 len: 0 microversion: 2.1 time: 0.264316 Apr 11 23:15:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 193/582] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:15:22 2023] POST /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ef82fbbc-e60e-471f-b791-8721b92897c3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1730 microversion: 2.1 time: 0.296113 Apr 11 23:15:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 197/583] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:23 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "name": "network-vif-plugged", "status": "completed", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] Creating event network-vif-plugged:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:15:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-78ce0c60-874c-4bca-8d6e-2fc89063aaab req-0fdbfff8-3ac7-469d-bf1e-d7d9bd6f6154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066154 Apr 11 23:15:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 194/584] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Creating event network-vif-unplugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:15:24 user devstack@n-api.service[61860]: DEBUG nova.compute.api [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:15:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2e969c19-ce3f-45e6-a2cf-987838b81800 req-46874784-c7a2-453f-95ea-3ec569075c7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201757 Apr 11 23:15:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 194/585] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:24 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3dcdc932-d40f-4e97-a874-8afecabbeb4d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1640 microversion: 2.1 time: 0.225898 Apr 11 23:15:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 198/586] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:24 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1640 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:15:26 user devstack@n-api.service[61861]: DEBUG nova.compute.api [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:15:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9803211e-ebc4-4295-b445-de2790c724b0 req-a3566faa-fa1b-43bc-8af5-f8987184e554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058952 Apr 11 23:15:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 195/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] [instance: f1767c12-a304-4d8c-a8bf-06e2bfa3aa59] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] HTTP exception thrown: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Request method failure captured: Apr 11 23:15:32 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 HTTP/1.1 Apr 11 23:15:32 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:15:32 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:15:32 user devstack@n-api.service[61860]: Connection: close Apr 11 23:15:32 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:15:32 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:15:32 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:15:32 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:15:32 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNelxVGuF4P5i1mDTqJPhFpgGfXMaB_9V03JDeJpCBeV1PqM-odfXrqybMAMaDAslba3YHhnrblmDOMK7TMGvnHFhT8f1wqzHI-jfs5UihdmtaoxlTM44DMQmBuW91sEdAphpNVFJMZTaOUPqkofUcuINMzCjxA2PFXyxKH7LHLVpwhc Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Project-Id: 8af76ed8ad9f4a429e346b6f8eedf895 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesNegativeTest-2128115870 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8af76ed8ad9f4a429e346b6f8eedf895"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8af76ed8ad9f4a429e346b6f8eedf895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8af76ed8ad9f4a429e346b6f8eedf895"}]}] Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesNegativeTest-2128115870 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Tenant-Id: 8af76ed8ad9f4a429e346b6f8eedf895 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesNegativeTest-2128115870 Apr 11 23:15:32 user devstack@n-api.service[61860]: X-User: tempest-VolumesNegativeTest-2128115870-project-member Apr 11 23:15:32 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:15:32 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:15:32 user devstack@n-api.service[61860]: X-User-Id: 6b9ffaa1f08b42ca9af5ce17a283f51b Apr 11 23:15:32 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesNegativeTest-2128115870-project-member Apr 11 23:15:32 user devstack@n-api.service[61860]: method: > Apr 11 23:15:32 user devstack@n-api.service[61860]: exception: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. Apr 11 23:15:32 user devstack@n-api.service[61860]: action_args: {'id': 'f1767c12-a304-4d8c-a8bf-06e2bfa3aa59'} Apr 11 23:15:32 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. Apr 11 23:15:32 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:15:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] Returning 404 to user: Instance f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:15:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-44a1355f-5c5b-4d9a-9481-d246a2f8aaa1 tempest-VolumesNegativeTest-2128115870 tempest-VolumesNegativeTest-2128115870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59" status: 404 len: 111 microversion: 2.1 time: 0.043803 Apr 11 23:15:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 195/588] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:32 2023] GET /compute/v2.1/servers/f1767c12-a304-4d8c-a8bf-06e2bfa3aa59 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:15:35 user devstack@n-api.service[61859]: DEBUG nova.compute.api [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:15:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6c67bda8-2a12-420b-aa75-ed1442689dd2 req-2a346fb0-2905-4fbe-b4db-8f3652a6bdff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068187 Apr 11 23:15:35 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 199/589] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:15:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-773bf017-7134-497a-aa30-a941ea633f94 req-703d8f06-c3f9-44b1-a14f-d77d1a39aed4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046009 Apr 11 23:15:37 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 196/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:38 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f85f46b3-46af-4327-a0bc-95a95bba4ad1 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 200 len: 1440 microversion: 2.1 time: 0.163729 Apr 11 23:15:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 196/591] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:38 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] Creating event network-changed:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:15:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6277e938-aa7c-4e7e-a237-ea5ad6cfeb6a req-47f8844a-326e-48f9-9ecb-8e3f7e1b4823 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146353 Apr 11 23:15:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 200/592] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:40 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:15:40 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-be7f72c8-dda4-4631-9d10-b4b836880135 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 204 len: 0 microversion: 2.1 time: 0.145823 Apr 11 23:15:40 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 197/593] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:15:40 2023] DELETE /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:40 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:41 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b459b872-a860-47bb-861c-c068efe6d910 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 200 len: 1446 microversion: 2.1 time: 0.182949 Apr 11 23:15:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 197/594] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:40 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 1446 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] Creating event network-vif-unplugged:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:15:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-2d6756eb-2200-465c-8dbb-a362f39fe296 req-0d6c0d25-64c0-4cca-889a-cd5ba2d5900f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028909 Apr 11 23:15:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 201/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "name": "network-vif-deleted", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] Creating event network-vif-deleted:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:15:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-dbf94c13-a5ba-4c10-9302-46a912f33380 req-f7749df4-653c-48f0-8146-5439f6e982e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Apr 11 23:15:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 198/596] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf3139-d486-40da-8ab9-e695e5fd539b", "name": "network-vif-plugged", "status": "completed", "tag": "d7aa2bb2-d610-4a03-b5fc-be956243a668"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] Creating event network-vif-plugged:d7aa2bb2-d610-4a03-b5fc-be956243a668 for instance 29cf3139-d486-40da-8ab9-e695e5fd539b on user Apr 11 23:15:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-d42f427e-7400-4eca-a7f9-06ad79ea4e35 req-2eb95be3-1803-4864-aed7-bf85c2e2c667 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030626 Apr 11 23:15:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 198/597] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:43 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-67891f74-d4e5-49f8-bc82-b745ebc37fae tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 200 len: 1487 microversion: 2.1 time: 0.184757 Apr 11 23:15:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 202/598] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:15:43 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 1487 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efc77cba-4e4e-4123-ad7e-a4d761c777ad"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f0e1e711-fa4e-4a70-a788-d45397aa36ce tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.587873 Apr 11 23:15:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 199/599] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 23:15:58 2023] POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments => generated 188 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4477fbbc-170a-4fce-94dc-22a093159c11 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments/efc77cba-4e4e-4123-ad7e-a4d761c777ad" status: 202 len: 0 microversion: 2.20 time: 0.241146 Apr 11 23:15:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 199/600] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 23:15:59 2023] DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments/efc77cba-4e4e-4123-ad7e-a4d761c777ad => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=14 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61859) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 23:15:59 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b0311d08-77a2-495e-a9b2-5a3fb21c9854 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/action" status: 202 len: 0 microversion: 2.20 time: 0.121846 Apr 11 23:15:59 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 203/601] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:15:59 2023] POST /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:15:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c7803729-b6db-44f6-ad1c-c654a6428b16 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1659 microversion: 2.20 time: 0.172146 Apr 11 23:15:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 200/602] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:15:59 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1659 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:16:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] Creating event network-changed:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:16:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-04f1d99c-d477-499f-9e0a-b28d64327558 req-d79d4ea5-45bb-4b06-8289-5391133f17df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Apr 11 23:16:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 200/603] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a5995b75-be3e-4acf-a80e-e1401f3ba35c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Action: 'create', calling method: .version_select at 0x7f3157cec790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1561116455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgAA/M8o66n0P5gxuVKww0/BCxA0rUaiV6ohdeuypE0j3Kmiiiuava13qXCYccyFsmSc/AuIKI2xHRcKEGO3MwIJuyx6Z95uIU1juqzY2j0pbX2+qlSqsiVm9Z0Pwdf/A=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:04 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-a5995b75-be3e-4acf-a80e-e1401f3ba35c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting quotas for project 3252362661dd4f8c9ad6298048a84c6a. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:16:04 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-a5995b75-be3e-4acf-a80e-e1401f3ba35c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting quotas for user acfb7fc33f4e4694bcc224292ac5f231 and project 3252362661dd4f8c9ad6298048a84c6a. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:16:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a5995b75-be3e-4acf-a80e-e1401f3ba35c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.139015 Apr 11 23:16:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 204/604] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:16:04 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] [instance: 410941af-9184-44ae-b416-b2a265c24f02] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] HTTP exception thrown: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Request method failure captured: Apr 11 23:16:04 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 HTTP/1.1 Apr 11 23:16:04 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:16:04 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:16:04 user devstack@n-api.service[61861]: Connection: close Apr 11 23:16:04 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:16:04 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:16:04 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:16:04 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:16:04 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNejNwlDipH1WhwaavDf2hHXEErbAx-YEYo4a9uLHaMPY5SBH684HYjBT-FDnvY5zCtvnL4FJz-hLyv0azARvl7uf9iHz36XvxHgHTWzTCrks8ZWDUazILkNXNn9tYO1GeEMGWEg8Re6J71880TKds4u5BOBXGDYLIdKWjanzs8YFz6s Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Project-Id: 154fad18f802436d95b15503e470d942 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/154fad18f802436d95b15503e470d942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/154fad18f802436d95b15503e470d942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/154fad18f802436d95b15503e470d942"}]}] Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Tenant-Id: 154fad18f802436d95b15503e470d942 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-76917881 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-User: tempest-VolumesSnapshotTestJSON-76917881-project-member Apr 11 23:16:04 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:16:04 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:16:04 user devstack@n-api.service[61861]: X-User-Id: e3995d8045154666b0ae890dd3de5ef3 Apr 11 23:16:04 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesSnapshotTestJSON-76917881-project-member Apr 11 23:16:04 user devstack@n-api.service[61861]: method: > Apr 11 23:16:04 user devstack@n-api.service[61861]: exception: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. Apr 11 23:16:04 user devstack@n-api.service[61861]: action_args: {'id': '410941af-9184-44ae-b416-b2a265c24f02'} Apr 11 23:16:04 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. Apr 11 23:16:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:16:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] Returning 404 to user: Instance 410941af-9184-44ae-b416-b2a265c24f02 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:16:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7a7fc6b5-72f5-4332-bd85-4ca98681ee1a tempest-VolumesSnapshotTestJSON-76917881 tempest-VolumesSnapshotTestJSON-76917881-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02" status: 404 len: 111 microversion: 2.1 time: 0.031143 Apr 11 23:16:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 201/605] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:04 2023] GET /compute/v2.1/servers/410941af-9184-44ae-b416-b2a265c24f02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:07 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8eb61800-fde4-4dba-9f98-d7a593315a3a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 200 len: 1542 microversion: 2.1 time: 0.160989 Apr 11 23:16:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 201/606] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:07 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 1542 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:08 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:08 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:08 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:16:08 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d69b82c3-e587-49b5-98ca-e29b36e67361 req-89e9d150-62e4-475e-a5b7-c7bdc6edfe03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Apr 11 23:16:08 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 205/607] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1643016946", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1561116455", "security_groups": [{"name": "tempest-secgroup-smoke-1032888181"}], "networks": [{"uuid": "843752b3-92e7-499c-a2fc-b924b39ada9e"}], "block_device_mapping_v2": [{"uuid": "1ba1bebe-9c96-4eb9-813a-593d2a5a4d94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] validate_networks() for [('843752b3-92e7-499c-a2fc-b924b39ada9e', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting quotas for project 3252362661dd4f8c9ad6298048a84c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Getting quotas for user acfb7fc33f4e4694bcc224292ac5f231 and project 3252362661dd4f8c9ad6298048a84c6a. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:16:08 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ba1bebe-9c96-4eb9-813a-593d2a5a4d94',volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:16:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-ab15ad44-066d-42ad-9f3f-f5fd81aad00f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.748828 Apr 11 23:16:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 202/608] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:16:08 2023] POST /compute/v2.1/servers => generated 404 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:16:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5846502f-c5a2-4413-ad92-87250332eaf8 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5846502f-c5a2-4413-ad92-87250332eaf8 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:09 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-5846502f-c5a2-4413-ad92-87250332eaf8 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5846502f-c5a2-4413-ad92-87250332eaf8 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1084 microversion: 2.1 time: 0.081729 Apr 11 23:16:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 202/609] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:09 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1084 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:16:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-efdd7c8c-3d84-4236-8e61-34b665ebb1d5 req-aa75bb58-3e59-4418-8f46-b0c39ab74f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030208 Apr 11 23:16:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 206/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:12 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] Creating event network-changed:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:16:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e0e6e184-7560-4438-9319-a847963c03c8 req-fa08d4ed-5300-46b7-988d-f48b60a96a83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035281 Apr 11 23:16:12 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 203/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:13 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a296d822-9fce-42a4-90e1-bbbe207d2674 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.166216 Apr 11 23:16:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 203/612] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:13 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:17 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:16:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-679d7b80-fe53-4a44-b7b4-aea9d2a4e8d7 req-69f956ce-7b7f-430b-af5f-8408d6bcf51d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049500 Apr 11 23:16:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 207/613] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:16:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c5ac6360-1f31-427a-8e78-97b6be68d390 req-64c5f6ff-b3b7-464f-a9c7-f4db3f4cd2e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Apr 11 23:16:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 204/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Going to try to start instance {{(pid=61860) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 23:16:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-beef6db2-2483-43cd-8396-826dbbad5024 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action" status: 202 len: 0 microversion: 2.1 time: 0.164886 Apr 11 23:16:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 204/615] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:16:25 2023] POST /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e0eade72-7e9a-4f72-8908-7dd1a45904b5 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1649 microversion: 2.1 time: 0.184337 Apr 11 23:16:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 208/616] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:25 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1649 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:28 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:16:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-625c7743-8ff3-4a0b-aedd-82532babfc18 req-688e6b35-06f0-4844-bd92-cda0b16b788e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048175 Apr 11 23:16:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 205/617] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:16:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-917235df-775d-4530-9e76-c7d1a5dd2bab req-34fc17bc-4ca1-455a-94ce-9ba84a6e7186 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064033 Apr 11 23:16:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 205/618] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:16:31 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b HTTP/1.1 Apr 11 23:16:31 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:16:31 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:16:31 user devstack@n-api.service[61859]: Connection: close Apr 11 23:16:31 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:16:31 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:16:31 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:16:31 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:16:31 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:16:31 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:16:31 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:16:31 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:16:31 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:16:31 user devstack@n-api.service[61859]: method: > Apr 11 23:16:31 user devstack@n-api.service[61859]: exception: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:16:31 user devstack@n-api.service[61859]: action_args: {'id': '29cf3139-d486-40da-8ab9-e695e5fd539b'} Apr 11 23:16:31 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:16:31 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:16:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:16:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4f70fb20-c518-4c77-893f-6bdf3b50ea49 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 404 len: 111 microversion: 2.1 time: 0.278343 Apr 11 23:16:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 209/619] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:31 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 111 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:16:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799938273", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-15540354", "security_groups": [{"name": "tempest-secgroup-smoke-1886511384"}], "block_device_mapping_v2": [{"uuid": "6170821e-16c7-4cae-a138-dbac84aea6cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:31 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:16:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6170821e-16c7-4cae-a138-dbac84aea6cd',volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:16:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c2e4ad01-fa54-464f-9c62-c66775b62175 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.009501 Apr 11 23:16:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 206/620] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:16:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:16:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d38408a5-a413-4772-8ed0-b1ccdce1b2e2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d38408a5-a413-4772-8ed0-b1ccdce1b2e2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:32 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-d38408a5-a413-4772-8ed0-b1ccdce1b2e2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d38408a5-a413-4772-8ed0-b1ccdce1b2e2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 200 len: 1088 microversion: 2.1 time: 0.102691 Apr 11 23:16:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 206/621] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:32 2023] GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 1088 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:16:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] Creating event network-changed:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:16:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-2594c84f-21af-4c96-8e87-a167f5ce711b req-f2a52bac-7e44-4e96-8ca1-5b51571d3184 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Apr 11 23:16:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 210/622] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "name": "network-vif-plugged", "status": "completed", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] Creating event network-vif-plugged:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:16:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ff165a2e-50a9-4304-8477-125225b077e8 req-94438310-37cc-4353-b63e-6e1bb5011bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042518 Apr 11 23:16:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 207/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:44 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b5fe4de8-d6f4-4a4f-969a-5ab83759d258 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1505 microversion: 2.1 time: 0.197392 Apr 11 23:16:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 207/624] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:43 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "name": "network-vif-plugged", "status": "completed", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] Creating event network-vif-plugged:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:16:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-dae7a92b-3e14-4cda-8264-092130047510 req-ac20fc58-f3e1-4998-9ad5-07ce81634b37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027686 Apr 11 23:16:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 211/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-10b6314f-2f75-4f39-8b93-747ed7d7985d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: .version_select at 0x7f3157957250>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1640213672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTEcgl/NhGv4Bb/P05E6qwS4i7frnTq227Fw8NjjabwTORj5LZJIXHiu7YOkH/BFyO3Oi3ku/v20lt1w55I01gZuEaexPUI/f5ofEy7HOCw5kg1vykKtzfwLhsywN4pww=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:44 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-10b6314f-2f75-4f39-8b93-747ed7d7985d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:16:44 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-10b6314f-2f75-4f39-8b93-747ed7d7985d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for user 6beb3cae81a14fa2bae48a8eedcb3868 and project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:16:45 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-10b6314f-2f75-4f39-8b93-747ed7d7985d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048101 Apr 11 23:16:45 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 208/626] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:16:44 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1117768809", "imageRef": "61c0c235-6d9e-44b6-aaf7-5005b1f3aba4", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1640213672", "networks": [{"uuid": "12bc1283-756b-41da-93c1-09d86844d45d"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] validate_networks() for [('12bc1283-756b-41da-93c1-09d86844d45d', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for user 6beb3cae81a14fa2bae48a8eedcb3868 and project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:16:45 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='61c0c235-6d9e-44b6-aaf7-5005b1f3aba4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:16:45 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-cd37b2a4-9aa7-4bec-9b9c-7ec4db457bdf tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.511717 Apr 11 23:16:45 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 208/627] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:16:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:16:45 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-26f94981-157b-4b5e-a418-20b51b84de00 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:45 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-26f94981-157b-4b5e-a418-20b51b84de00 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:45 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-26f94981-157b-4b5e-a418-20b51b84de00 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-26f94981-157b-4b5e-a418-20b51b84de00 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1253 microversion: 2.1 time: 0.067222 Apr 11 23:16:45 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 212/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:45 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1253 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:16:48 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:48 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:48 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] Creating event network-changed:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:16:48 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ec740ebc-4e3c-4534-9cee-2ee32646059b req-2d8d6b37-d10d-4d39-bce1-549a6618f05b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067317 Apr 11 23:16:48 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 209/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:49 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5d1f61ef-c80f-4717-a396-945d214f5d1e tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1704 microversion: 2.20 time: 0.147446 Apr 11 23:16:49 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 209/630] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:16:49 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1704 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:16:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:16:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-8c68dd6d-556e-49d6-b746-532aa6cad67f req-3898b14c-d448-41de-b20d-3c150946e8c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070982 Apr 11 23:16:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 213/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:16:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:16:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:16:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c477c4de-23da-4b7e-91fe-9eeae20817ae req-0db5e6d8-1de6-42a5-bb32-ff255778c7c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050397 Apr 11 23:16:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 210/632] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:16:59 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:16:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-03ce5ddc-3d22-4abe-973b-4f1d04bd1ee5 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1433 microversion: 2.1 time: 0.203959 Apr 11 23:16:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 210/633] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:16:59 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1433 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=11 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=7 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bbb5e33b-d7b3-439c-8807-4355f02160da tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098028 Apr 11 23:17:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 214/634] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:17:07 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] Creating event network-changed:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:17:08 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9f410ead-5504-4550-bdaa-7b5af36abe3b req-35f47f4a-c58a-4769-8b35-06adf186bb78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040825 Apr 11 23:17:08 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 211/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-bdb252d1-e4bf-4f6b-9c4f-a65e60a9764e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/ips" status: 200 len: 106 microversion: 2.1 time: 0.036299 Apr 11 23:17:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 211/636] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:17:08 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/ips => generated 106 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e2058e1-f925-4535-8b08-6fd8bc0f20c8"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e8620352-7c19-424c-99f8-99b038d09d42 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315674 Apr 11 23:17:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 215/637] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:17:09 2023] POST /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:14 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-17864ce6-0cb5-4e5b-a37e-390a31b66637 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.194292 Apr 11 23:17:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 212/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:13 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=25 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a7b30e6c-d482-4a39-849c-bfed09ebb2bd tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1723 microversion: 2.1 time: 0.172142 Apr 11 23:17:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 212/639] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:14 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:15 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6f08fa94-c2d5-4ba8-9e86-2a3d53ce1b6c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1653 microversion: 2.1 time: 0.154894 Apr 11 23:17:15 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 216/640] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:15 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e2058e1-f925-4535-8b08-6fd8bc0f20c8"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:17:16 user devstack@n-api.service[61861]: request: POST /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments HTTP/1.1 Apr 11 23:17:16 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:17:16 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:17:16 user devstack@n-api.service[61861]: Connection: close Apr 11 23:17:16 user devstack@n-api.service[61861]: Content-Length: 74 Apr 11 23:17:16 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:17:16 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:17:16 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:17:16 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:17:16 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:17:16 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:17:16 user devstack@n-api.service[61861]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:17:16 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:17:16 user devstack@n-api.service[61861]: Apr 11 23:17:16 user devstack@n-api.service[61861]: {"volumeAttachment": {"volumeId": "9e2058e1-f925-4535-8b08-6fd8bc0f20c8"}} Apr 11 23:17:16 user devstack@n-api.service[61861]: method: > Apr 11 23:17:16 user devstack@n-api.service[61861]: exception: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 Apr 11 23:17:16 user devstack@n-api.service[61861]: action_args: {'server_id': 'f1a98583-cd58-4078-999f-f2bfb3a50c48', 'body': {'volumeAttachment': {'volumeId': '9e2058e1-f925-4535-8b08-6fd8bc0f20c8'}}} Apr 11 23:17:16 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 Apr 11 23:17:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:17:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 400 to user: Invalid volume: volume 9e2058e1-f925-4535-8b08-6fd8bc0f20c8 is already attached to instances: f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:17:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-ed2e4547-0cb9-435f-8a1b-beabf3f2af17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100736 Apr 11 23:17:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 213/641] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:17:16 2023] POST /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:16 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'services' on Instance uuid f1a98583-cd58-4078-999f-f2bfb3a50c48 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:17:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3aae6e0c-9781-45f3-ad5a-541665444f95 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments/9e2058e1-f925-4535-8b08-6fd8bc0f20c8" status: 202 len: 0 microversion: 2.1 time: 0.190096 Apr 11 23:17:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 213/642] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:17:16 2023] DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments/9e2058e1-f925-4535-8b08-6fd8bc0f20c8 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b0234faf-193c-4817-be7b-35880709e6c3 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Apr 11 23:17:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 217/643] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:17:17 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-569c3878-401f-4932-b606-42fbbd219173 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 200 len: 1441 microversion: 2.1 time: 0.261768 Apr 11 23:17:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 214/644] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:22 2023] GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 1441 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:35 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-310bd21c-7afa-42ca-acc0-25c3874fc753 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1537 microversion: 2.1 time: 0.176020 Apr 11 23:17:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 214/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:35 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:45 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid dd8aa618-99bb-49d7-b547-e5db4470f4c6 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:17:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-000bfc0b-5f45-4a57-b1d0-e7cba948f8be tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/action" status: 200 len: 32 microversion: 2.1 time: 0.109236 Apr 11 23:17:45 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 218/646] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:17:45 2023] POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=20 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:45 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:45 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6504844b-f3fe-4783-a6b5-c87111642f95 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1511 microversion: 2.1 time: 0.247539 Apr 11 23:17:45 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 215/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:45 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-unplugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] Creating event network-vif-unplugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:17:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-58eb7c55-5495-4315-88a0-37d2c55db8ba req-62bc7c19-ee5d-4c29-8e20-762181125c94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036157 Apr 11 23:17:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 215/648] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:17:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-be231da8-d6bc-498a-a4cc-eceaadac20bc req-9e03df9f-4627-49ff-b164-f8e12824ded4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Apr 11 23:17:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 219/649] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-54228b3c-6f96-4819-a2c3-eef388bd7870 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044461 Apr 11 23:17:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 216/650] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 23:17:50 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:17:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-f709d327-6dce-40e6-b467-bddc75ed353d tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 204 len: 0 microversion: 2.20 time: 0.131581 Apr 11 23:17:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 216/651] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:17:50 2023] DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:50 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7272af33be864737b2231127f4323638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466a7e141a247319eae64ab30aca760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2fe6e043-ec87-4e99-9e40-9985cf075bc8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 200 len: 1710 microversion: 2.20 time: 0.206080 Apr 11 23:17:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 220/652] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:17:50 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] Creating event network-vif-unplugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:17:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5cab17e1-8bc1-4185-aa6d-276b299d4ef8 req-9d9c5ac4-034f-4eb2-85b4-3ad292faa8a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044974 Apr 11 23:17:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 217/653] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}, {"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:17:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:17:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-73932341-db08-41aa-978a-0081b35438e2 req-8c054345-759e-4c0c-bede-3512052bdd50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032751 Apr 11 23:17:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:17:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-plugged", "status": "completed", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}, {"server_uuid": "fab7f71b-57f6-415b-9d2d-262a8ec6cb03", "name": "network-vif-deleted", "tag": "5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:17:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Creating event network-vif-plugged:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:17:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] Creating event network-vif-deleted:5f6c4dd1-5be1-45f1-ad57-bcf56a3bef1a for instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 on user Apr 11 23:17:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-6efc8e5a-af9e-4f41-903f-d73475578703 req-6fe09a54-c430-40d2-8256-d521c327d34c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040673 Apr 11 23:17:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 221/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:17:59 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:17:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-af3a7c91-bdd9-435c-82e5-5ddbaf4ed68b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1433 microversion: 2.1 time: 0.151649 Apr 11 23:17:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 218/656] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:17:59 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1433 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] Creating event network-changed:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:18:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-553d96be-9972-4ce5-9357-81fada0f6161 req-77de7058-822e-412c-979e-507e6e8e00d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037818 Apr 11 23:18:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 218/657] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:01 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lazy-loading 'flavor' on Instance uuid 8d9f6a0d-caab-4f42-a9b1-a4653b90559f {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:18:01 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-67736ec7-a1db-4fe3-8c30-5011de2fd2a6 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/action" status: 202 len: 0 microversion: 2.1 time: 0.109013 Apr 11 23:18:01 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 222/658] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:18:01 2023] POST /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:02 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-76806c3f-ad15-46be-b14f-27eaf279bc49 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1439 microversion: 2.1 time: 0.327573 Apr 11 23:18:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:01 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1439 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-unplugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] Creating event network-vif-unplugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:18:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-0cbf9109-197b-40b7-b1e0-5756d5a31d68 req-96f2489b-da90-4eb6-905f-d1039bee5b07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037860 Apr 11 23:18:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 219/660] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] Creating event network-changed:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:18:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0f0b9983-ddd8-44b6-a796-1089f54c9e15 req-1ed4d885-a0ef-4773-8b85-039afe207959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030220 Apr 11 23:18:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 223/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:18:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-40a3b4dc-722b-404c-b50f-b2b8acb701d5 req-a0cebf51-311f-4248-a510-91d8e9a6168b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Apr 11 23:18:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 220/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e774ae38-0b7d-4b4b-aeb2-b1ced520c863 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048506 Apr 11 23:18:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 220/663] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:18:07 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:18:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0de39bcd-fe81-433c-bd69-2273908d05db tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 204 len: 0 microversion: 2.1 time: 0.112768 Apr 11 23:18:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 224/664] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:18:07 2023] DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-1781ce67-a8ea-4411-909d-66805b114df5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 200 len: 1667 microversion: 2.1 time: 0.189935 Apr 11 23:18:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 221/665] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:07 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "name": "network-vif-unplugged", "status": "completed", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] Creating event network-vif-unplugged:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:18:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-f6767d4f-fce6-4681-a3b4-d6767681533c req-f5bca3ba-4fab-43e4-9f0f-d8cf7328d684 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037033 Apr 11 23:18:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 221/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "name": "network-vif-plugged", "status": "completed", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}, {"server_uuid": "f1a98583-cd58-4078-999f-f2bfb3a50c48", "name": "network-vif-deleted", "tag": "cab6e033-a51b-4b0b-9e76-c55de3afcef6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Creating event network-vif-plugged:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:18:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] Creating event network-vif-deleted:cab6e033-a51b-4b0b-9e76-c55de3afcef6 for instance f1a98583-cd58-4078-999f-f2bfb3a50c48 on user Apr 11 23:18:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-550be5d4-76f1-4aff-ab41-3df8c5e78427 req-8f64e8ab-5f24-41ee-aae8-d8c925d2e5be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035007 Apr 11 23:18:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 225/667] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:14 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:18:14 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-773323e5-82ba-4a8d-83ad-9d67d9ed4141 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 204 len: 0 microversion: 2.1 time: 0.156486 Apr 11 23:18:14 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 222/668] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:18:14 2023] DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:14 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-91acc5fa-39a2-48a8-b8e4-59ec1576112c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 200 len: 1729 microversion: 2.1 time: 0.186493 Apr 11 23:18:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 222/669] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:14 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] Creating event network-vif-unplugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:18:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0d0ee1e6-ea5e-45e3-b8f4-6c0491cd6213 req-4736eab8-e172-4050-9b93-31667f3d4f50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030870 Apr 11 23:18:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 226/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f578e014-1980-4a4e-befe-1a2c0c9b02a2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052918 Apr 11 23:18:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:18:15 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:16 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:18:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4f080ffe-cf41-4252-ad05-ed1bce211c25 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 204 len: 0 microversion: 2.1 time: 0.112473 Apr 11 23:18:16 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 223/672] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:18:16 2023] DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:16 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5d8c67f6-2d56-47da-8a69-fa388d8aa207 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 200 len: 1659 microversion: 2.1 time: 0.212507 Apr 11 23:18:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 227/673] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:16 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 1659 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-deleted", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] Creating event network-vif-deleted:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:18:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-a9f6990c-f09e-4818-99ad-8b8ab5a313c8 req-f580fbf0-8857-4398-8179-cffa697465b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Apr 11 23:18:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 224/674] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:17 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed8cea5-9e5c-4467-8993-456cb3235fd8", "name": "network-vif-plugged", "status": "completed", "tag": "961d8195-c0d7-49eb-bfd7-05ee4b3e6112"}, {"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-unplugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}, {"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-plugged", "status": "completed", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Creating event network-vif-plugged:961d8195-c0d7-49eb-bfd7-05ee4b3e6112 for instance eed8cea5-9e5c-4467-8993-456cb3235fd8 on user Apr 11 23:18:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Creating event network-vif-unplugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:18:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] Creating event network-vif-plugged:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:18:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-f1ec0960-5b08-4f4b-b851-f81d9074db64 req-a79513ba-b890-413d-9b20-34bb15a17eb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.140286 Apr 11 23:18:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 224/675] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:17 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d31874-4273-48bc-8811-89832d18b893", "name": "network-vif-deleted", "tag": "ac90e400-803b-41b5-b183-f93bfbf297b6"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] Creating event network-vif-deleted:ac90e400-803b-41b5-b183-f93bfbf297b6 for instance e4d31874-4273-48bc-8811-89832d18b893 on user Apr 11 23:18:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c4b2e059-862e-4f38-a0cd-f9a36c62835c req-5859fb2d-36a4-4b0a-bd31-84fe73486327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Apr 11 23:18:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 228/676] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-89874070-f037-405d-9b06-e8a72e186c40 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 200 len: 1441 microversion: 2.1 time: 0.223700 Apr 11 23:18:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 225/677] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:22 2023] GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 1441 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] Creating event network-changed:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:18:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-fc71c9c8-57da-4743-8519-63eee4dc8be9 req-9de7fbcf-61c5-4afe-8434-c5015e0fae6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034812 Apr 11 23:18:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 225/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1048278755", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-15540354", "security_groups": [{"name": "tempest-secgroup-smoke-1886511384"}], "block_device_mapping_v2": [{"uuid": "c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b0b025e-1b9f-4d76-bce2-a472746f676b"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:27 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] validate_networks() for [('7b0b025e-1b9f-4d76-bce2-a472746f676b', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Getting quotas for user 589c07cd12e849cfa38423959e76c695 and project f6700d66136e4f9590658e3103cceac8. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:18:28 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8f5a0a8-dc6b-4652-8db1-a6a6f23d65d4',volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:18:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-59af1165-ebb2-44a9-bdd8-7e665fec212a tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.755391 Apr 11 23:18:28 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 229/679] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:18:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:18:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-62f8e9d2-8bfd-4b04-b40c-58535dee8611 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:28 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-62f8e9d2-8bfd-4b04-b40c-58535dee8611 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:28 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-62f8e9d2-8bfd-4b04-b40c-58535dee8611 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-62f8e9d2-8bfd-4b04-b40c-58535dee8611 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 200 len: 1088 microversion: 2.1 time: 0.087778 Apr 11 23:18:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 226/680] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:28 2023] GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] Creating event network-changed:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:18:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-706c7399-455a-48a1-aa38-83a52a80422f req-270fb4f3-961b-4319-b85d-eb3a705f4835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035190 Apr 11 23:18:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 226/681] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=13 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bddfdf7a-11e5-4423-a623-3c25a244ba64 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1537 microversion: 2.1 time: 0.176762 Apr 11 23:18:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 227/682] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:35 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching by: {'deleted': False, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f'} {{(pid=61860) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0ee43edf-ff20-4114-9d02-c7b13d4dac69 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1491 microversion: 2.1 time: 0.361128 Apr 11 23:18:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 230/683] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:35 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1491 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:36 user devstack@n-api.service[61860]: DEBUG nova.compute.multi_cell_list [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 23:18:36 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e9de4e90-8a15-4e80-a661-11dc14dd17b8 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.201298 Apr 11 23:18:36 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 23:18:36 2023] GET /compute/v2.1/servers => generated 341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "name": "network-vif-plugged", "status": "completed", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] Creating event network-vif-plugged:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:18:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-7a960c21-ca86-489e-a1b2-d5814c189e5a req-dd7df528-2f4f-4bc0-bff0-120ea48d6f94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039614 Apr 11 23:18:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 228/685] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:36 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-fd578781-b8b0-45b8-b4dd-306493d05e12 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1537 microversion: 2.1 time: 0.222004 Apr 11 23:18:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 231/686] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:36 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c7fe861-90c1-4630-a64a-73b40239df5e"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "name": "network-vif-plugged", "status": "completed", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] Creating event network-vif-plugged:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:18:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1478a0f5-c9ac-4e13-a0d9-2f9b3cead0ac req-cde6a79d-4a76-449d-9735-42c5df1135ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036274 Apr 11 23:18:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 229/687] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a82fdfb4-f1fa-4349-a978-3d397842a971 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324785 Apr 11 23:18:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 228/688] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:18:38 2023] POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:18:40 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 HTTP/1.1 Apr 11 23:18:40 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:18:40 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:18:40 user devstack@n-api.service[61859]: Connection: close Apr 11 23:18:40 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:18:40 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:18:40 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:18:40 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:18:40 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:40 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:18:40 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:18:40 user devstack@n-api.service[61859]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:18:40 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:40 user devstack@n-api.service[61859]: method: > Apr 11 23:18:40 user devstack@n-api.service[61859]: exception: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:40 user devstack@n-api.service[61859]: action_args: {'id': 'fab7f71b-57f6-415b-9d2d-262a8ec6cb03'} Apr 11 23:18:40 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:40 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:40 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:40 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-95f72a37-61fc-4892-9746-37335bf311a8 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 404 len: 111 microversion: 2.20 time: 0.032440 Apr 11 23:18:40 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 232/689] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:18:40 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:18:40 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:40 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f178e577-78e1-46a5-83d2-8ec163bcd369 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '.version_select at 0x7f31347e7250>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:40 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f178e577-78e1-46a5-83d2-8ec163bcd369 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-865048007" status: 204 len: 0 microversion: 2.20 time: 0.027419 Apr 11 23:18:40 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 230/690] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 23:18:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-865048007 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:18:43 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 HTTP/1.1 Apr 11 23:18:43 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:18:43 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:18:43 user devstack@n-api.service[61860]: Connection: close Apr 11 23:18:43 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:18:43 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:18:43 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:18:43 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:18:43 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:43 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:18:43 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:18:43 user devstack@n-api.service[61860]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:18:43 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:43 user devstack@n-api.service[61860]: method: > Apr 11 23:18:43 user devstack@n-api.service[61860]: exception: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61860]: action_args: {'id': 'fab7f71b-57f6-415b-9d2d-262a8ec6cb03'} Apr 11 23:18:43 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-31910fd3-5a0c-41ca-ac30-695b4e5b3a21 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 404 len: 111 microversion: 2.20 time: 0.030819 Apr 11 23:18:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 229/691] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:18:43 2023] DELETE /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: fab7f71b-57f6-415b-9d2d-262a8ec6cb03] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:18:43 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 HTTP/1.1 Apr 11 23:18:43 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:18:43 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:18:43 user devstack@n-api.service[61859]: Connection: close Apr 11 23:18:43 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:18:43 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:18:43 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:18:43 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:18:43 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:43 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:18:43 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:18:43 user devstack@n-api.service[61859]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:18:43 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:43 user devstack@n-api.service[61859]: method: > Apr 11 23:18:43 user devstack@n-api.service[61859]: exception: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61859]: action_args: {'id': 'fab7f71b-57f6-415b-9d2d-262a8ec6cb03'} Apr 11 23:18:43 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. Apr 11 23:18:43 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance fab7f71b-57f6-415b-9d2d-262a8ec6cb03 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6afac1ee-9f5c-4a6a-8232-46b5f4f8c89c tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03" status: 404 len: 111 microversion: 2.20 time: 0.027009 Apr 11 23:18:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 233/692] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:18:43 2023] GET /compute/v2.1/servers/fab7f71b-57f6-415b-9d2d-262a8ec6cb03 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:18:46 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f HTTP/1.1 Apr 11 23:18:46 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:18:46 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:18:46 user devstack@n-api.service[61861]: Connection: close Apr 11 23:18:46 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:18:46 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:18:46 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:18:46 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:18:46 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:46 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:18:46 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:18:46 user devstack@n-api.service[61861]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:18:46 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:46 user devstack@n-api.service[61861]: method: > Apr 11 23:18:46 user devstack@n-api.service[61861]: exception: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61861]: action_args: {'id': '8322b884-2831-48af-a67e-26c31c17f49f'} Apr 11 23:18:46 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-abbc1d10-3af7-4563-8c42-62072e206758 tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 404 len: 111 microversion: 2.20 time: 0.038170 Apr 11 23:18:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 231/693] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:18:45 2023] DELETE /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] [instance: 8322b884-2831-48af-a67e-26c31c17f49f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] HTTP exception thrown: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Request method failure captured: Apr 11 23:18:46 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f HTTP/1.1 Apr 11 23:18:46 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:18:46 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:18:46 user devstack@n-api.service[61860]: Connection: close Apr 11 23:18:46 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:18:46 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:18:46 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:18:46 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:18:46 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeeL8JO1xODC_bvgheCidsegjoIgrPnuPYy8WRv1P6dxGBkBOnGOvqFicRzVTberz_DR4oGV7wJIC-mJmjoZdz3zpP2kj5eplSaC9Zoqrtm7L6OQL0rPrlHbc2mWRQNnoEf4NCiIZitkh4GWlQgtysNcqmAFNto_YQdhalU2Auevpo8 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Project-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b466a7e141a247319eae64ab30aca760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b466a7e141a247319eae64ab30aca760"}]}] Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Tenant-Id: b466a7e141a247319eae64ab30aca760 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1849897654 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:46 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:18:46 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:18:46 user devstack@n-api.service[61860]: X-User-Id: 7272af33be864737b2231127f4323638 Apr 11 23:18:46 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1849897654-project-member Apr 11 23:18:46 user devstack@n-api.service[61860]: method: > Apr 11 23:18:46 user devstack@n-api.service[61860]: exception: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61860]: action_args: {'id': '8322b884-2831-48af-a67e-26c31c17f49f'} Apr 11 23:18:46 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. Apr 11 23:18:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:18:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] Returning 404 to user: Instance 8322b884-2831-48af-a67e-26c31c17f49f could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-2bb41602-ca99-421e-b9cd-f1181d0aa97b tempest-AttachVolumeShelveTestJSON-1849897654 tempest-AttachVolumeShelveTestJSON-1849897654-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f" status: 404 len: 111 microversion: 2.20 time: 0.033612 Apr 11 23:18:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 230/694] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:18:46 2023] GET /compute/v2.1/servers/8322b884-2831-48af-a67e-26c31c17f49f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=26 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:47 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-539d927e-681a-4959-af89-a09a9d139844 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1583 microversion: 2.1 time: 0.162157 Apr 11 23:18:47 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 234/695] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:47 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1583 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:49 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:49 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:49 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] Creating event network-changed:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:18:49 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e4e258fe-e2c5-4053-a4ff-b4a863a126c7 req-c65f3cc0-331c-4e6d-90e8-af543b8df720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033620 Apr 11 23:18:49 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 232/696] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1323348752"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:51 user devstack@n-api.service[61860]: INFO nova.network.security_group_api [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Adding security group 36b2d468-146e-4961-b993-4b54a17756ff to port 86961f23-bd39-44da-8ad9-4420b80e9223 Apr 11 23:18:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eb20f45c-99b2-4345-9175-c092d895b167 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.579788 Apr 11 23:18:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 231/697] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:18:50 2023] POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] Creating event network-changed:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:18:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-46db0756-ba58-4d0a-a312-a224147b55a0 req-81097649-74e7-48d7-9f0e-0688ef0b5a94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Apr 11 23:18:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 233/698] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:51 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-171d718e-1248-4d61-9d34-96e311d492b9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1749 microversion: 2.1 time: 0.165496 Apr 11 23:18:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 235/699] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:51 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:52 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-22264089-98ee-4eb1-9416-cb8e903d5f6c tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1498 microversion: 2.1 time: 0.150922 Apr 11 23:18:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 232/700] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:52 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a4491796-ba41-4f9d-8ac4-1de4352e95eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.094234 Apr 11 23:18:53 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 234/701] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:18:52 2023] POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:53 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:18:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-647556ca-05e1-4b28-9daa-4d7cc108d6a5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1751 microversion: 2.1 time: 0.161663 Apr 11 23:18:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 236/702] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:53 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:18:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] Creating event network-vif-unplugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:18:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-dd7a19fa-0af3-4310-b412-25eb00277470 req-feaf0f2e-6cf7-4e45-8f22-159b7a8238c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033735 Apr 11 23:18:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 233/703] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:55 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:18:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-b38d43d4-91c7-40cb-9047-e3d44ba383ce req-c46b9df7-03e0-4074-9bea-29f348a54654 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Apr 11 23:18:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 235/704] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:18:57 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 HTTP/1.1 Apr 11 23:18:57 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:18:57 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:18:57 user devstack@n-api.service[61859]: Connection: close Apr 11 23:18:57 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:18:57 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:18:57 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:18:57 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:18:57 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:18:57 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:18:57 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:18:57 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:18:57 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:18:57 user devstack@n-api.service[61859]: method: > Apr 11 23:18:57 user devstack@n-api.service[61859]: exception: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:18:57 user devstack@n-api.service[61859]: action_args: {'id': 'f1a98583-cd58-4078-999f-f2bfb3a50c48'} Apr 11 23:18:57 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:18:57 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:18:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:18:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-8739a876-9a6f-4c07-a9e9-1e066beaff85 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 404 len: 111 microversion: 2.1 time: 0.027297 Apr 11 23:18:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 237/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:18:57 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:18:57 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-feff7126-a116-41a5-94a3-0d2da0289caa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '.version_select at 0x7f315772b490>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:18:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-feff7126-a116-41a5-94a3-0d2da0289caa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357942564" status: 202 len: 0 microversion: 2.1 time: 0.022496 Apr 11 23:18:57 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 234/706] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 23:18:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357942564 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:18:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:18:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:18:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:18:58 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-82a6bdee-d06d-409a-857b-8a7f6304daf5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: .version_select at 0x7f3157ced990>, body: {"keypair": {"name": "tempest-keypair-1508967452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhRiArT29Rv92Wh1N2Mt98TPn5xlam31Hu8Z75IA4+J6QNB3eeaIWgcW3gwaUMUpR1wXJRGFbU5LHD1vOHhxsWwkp54eRAOxnFQP1vQNXofezaTxUI9CI1Kb2w/uTa/Qw=="}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:18:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:18:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-cc737115-b09f-4aa7-9d6d-ad69f65b9de3 req-aa50daf8-0ba8-4f04-83e5-aa64ce57679e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053120 Apr 11 23:18:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 236/707] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:18:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:18:58 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-82a6bdee-d06d-409a-857b-8a7f6304daf5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:18:58 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-82a6bdee-d06d-409a-857b-8a7f6304daf5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'key_pairs'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:18:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-82a6bdee-d06d-409a-857b-8a7f6304daf5 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062746 Apr 11 23:18:58 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 238/708] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:18:58 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-970474155", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f013a872-a4db-4d26-8b73-353db89b647e"}], "security_groups": [{"name": "tempest-securitygroup--184091637"}], "key_name": "tempest-keypair-1508967452", "user_data": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] validate_networks() for [('f013a872-a4db-4d26-8b73-353db89b647e', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:19:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:19:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-696372ed-5a7c-44a8-a5b2-089d39acf35f req-9a5aea50-cb9a-4060-ba4f-0fcf7ba0de74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040585 Apr 11 23:19:00 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 237/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Getting quotas for user da1389f3e27f49f394598636d041a9c9 and project 9f29d28c472c4f65b8437ce443d208c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:19:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:19:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a0d0defe-36be-45ec-a736-9f5780dcb69a tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.591682 Apr 11 23:19:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 235/710] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:19:00 2023] POST /compute/v2.1/servers => generated 399 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:19:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0f23c17b-8b27-4396-8a3e-d6e6e8b60c34 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0f23c17b-8b27-4396-8a3e-d6e6e8b60c34 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-0f23c17b-8b27-4396-8a3e-d6e6e8b60c34 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0f23c17b-8b27-4396-8a3e-d6e6e8b60c34 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 200 len: 1235 microversion: 2.1 time: 0.078222 Apr 11 23:19:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 239/711] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:00 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] Creating event network-changed:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:19:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-77eeedad-0ad5-41bb-80e1-1047a399d7ed req-6e92b8e4-6d5b-493e-a93b-b77f15059293 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033741 Apr 11 23:19:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 238/712] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:19:04 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 HTTP/1.1 Apr 11 23:19:04 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:19:04 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:19:04 user devstack@n-api.service[61860]: Connection: close Apr 11 23:19:04 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:19:04 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:19:04 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:19:04 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:19:04 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61860]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:19:04 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61860]: method: > Apr 11 23:19:04 user devstack@n-api.service[61860]: exception: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61860]: action_args: {'id': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'} Apr 11 23:19:04 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:19:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8cd2cf9f-5842-415b-acd0-cf0f3f63a724 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 404 len: 111 microversion: 2.1 time: 0.034388 Apr 11 23:19:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 236/713] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:04 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:19:04 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments HTTP/1.1 Apr 11 23:19:04 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:19:04 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:19:04 user devstack@n-api.service[61859]: Connection: close Apr 11 23:19:04 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:19:04 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:19:04 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:19:04 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:19:04 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61859]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:19:04 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61859]: method: > Apr 11 23:19:04 user devstack@n-api.service[61859]: exception: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61859]: action_args: {'server_id': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'} Apr 11 23:19:04 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:19:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2c38e813-ae44-4d2c-afe3-b93eb7f2e099 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030198 Apr 11 23:19:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 240/714] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:19:04 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:19:04 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 HTTP/1.1 Apr 11 23:19:04 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:19:04 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:19:04 user devstack@n-api.service[61861]: Connection: close Apr 11 23:19:04 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:19:04 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:19:04 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:19:04 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:19:04 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:19:04 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:19:04 user devstack@n-api.service[61861]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:19:04 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:19:04 user devstack@n-api.service[61861]: method: > Apr 11 23:19:04 user devstack@n-api.service[61861]: exception: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61861]: action_args: {'id': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'} Apr 11 23:19:04 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:19:04 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:19:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:19:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f5db1b7b-857e-4f6c-bc28-e47a0f461713 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 404 len: 111 microversion: 2.1 time: 0.029722 Apr 11 23:19:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 239/715] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:04 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:19:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-3910123", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "f9e1c987-17bb-42a1-9005-96fcd25d79c0"}], "security_groups": [{"name": "tempest-securitygroup--1661352765"}], "key_name": "tempest-keypair-1554463927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:05 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] validate_networks() for [('f9e1c987-17bb-42a1-9005-96fcd25d79c0', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:19:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:19:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d323b9ce-1df1-49b9-914e-9d06f998e75b req-e750b636-d54a-4c3b-bcc2-c2c804f85a83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Apr 11 23:19:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 241/716] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-077f3df5-0cc1-48fc-9bcb-5a65f8247309 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.144160 Apr 11 23:19:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 237/717] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:19:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:19:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-264e112a-4480-4f96-b1db-351c23028ef2 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:06 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-264e112a-4480-4f96-b1db-351c23028ef2 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:06 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-264e112a-4480-4f96-b1db-351c23028ef2 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-264e112a-4480-4f96-b1db-351c23028ef2 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 200 len: 1230 microversion: 2.1 time: 0.066806 Apr 11 23:19:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 240/718] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:06 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 1230 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:19:06 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 HTTP/1.1 Apr 11 23:19:06 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:19:06 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:19:06 user devstack@n-api.service[61859]: Connection: close Apr 11 23:19:06 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:19:06 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:19:06 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:19:06 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:19:06 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:19:06 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:19:06 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:19:06 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:19:06 user devstack@n-api.service[61859]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:19:06 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:19:06 user devstack@n-api.service[61859]: method: > Apr 11 23:19:06 user devstack@n-api.service[61859]: exception: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:19:06 user devstack@n-api.service[61859]: action_args: {'id': 'e4d31874-4273-48bc-8811-89832d18b893'} Apr 11 23:19:06 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:19:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:19:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d4aa04e4-7602-476f-85a4-93e6c966aad3 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 404 len: 111 microversion: 2.1 time: 0.040823 Apr 11 23:19:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 242/719] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:06 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:19:06 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-239202c2-7510-4e7d-846f-48a1a6590e4f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '.version_select at 0x7f3157505120>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-239202c2-7510-4e7d-846f-48a1a6590e4f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759307061" status: 202 len: 0 microversion: 2.1 time: 0.024815 Apr 11 23:19:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 238/720] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 23:19:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759307061 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:19:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-95ebc16d-1820-4d85-aef5-614221dee55a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: .version_select at 0x7f3134690dc0>, body: {"keypair": {"name": "tempest-keypair-1733576032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd6J9Hfhfl3k6suA3VXx505Hz3ymCZc6NkXJqG6wdldGsvO/ASBV5wMoZFTIiO5UnutLW+qfE9dn9LQpAB0adzm2fiHkMxgQ9UOrhoV8PdfuFDGyKYzVyo6Y9veMg9JWg=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:07 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-95ebc16d-1820-4d85-aef5-614221dee55a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:19:07 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-95ebc16d-1820-4d85-aef5-614221dee55a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for user 1793cec543e8425899474614b2c10f5d and project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:19:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-95ebc16d-1820-4d85-aef5-614221dee55a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065409 Apr 11 23:19:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 241/721] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:19:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:07 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:07 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:19:07 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-48c7ef89-ed91-4308-85c2-f6092361fae0 req-38b2a93a-f046-48a0-91ef-c3e282974c70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067694 Apr 11 23:19:07 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 243/722] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:08 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] Creating event network-changed:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:19:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-00c09efd-4324-4981-969b-28b00d9afe2f req-bb670154-29db-4797-adaa-3c065a9c4067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060076 Apr 11 23:19:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 239/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1752444058", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c4d6de35-af1a-4dd1-9efe-b1b10bbcc909"}], "security_groups": [{"name": "tempest-securitygroup--498785552"}], "key_name": "tempest-keypair-1733576032", "user_data": "}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] validate_networks() for [('c4d6de35-af1a-4dd1-9efe-b1b10bbcc909', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Getting quotas for user 1793cec543e8425899474614b2c10f5d and project f0ff3d48596a44f8ac8d9306becd8178. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:19:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:19:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d47267ac-b771-42f0-96bd-e1689cd53250 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.863741 Apr 11 23:19:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 242/724] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:19:09 2023] POST /compute/v2.1/servers => generated 399 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:19:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ead69d96-528d-44cf-a6c1-039027e72560 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ead69d96-528d-44cf-a6c1-039027e72560 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:10 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-ead69d96-528d-44cf-a6c1-039027e72560 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ead69d96-528d-44cf-a6c1-039027e72560 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 200 len: 1232 microversion: 2.1 time: 0.078269 Apr 11 23:19:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 244/725] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:09 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 1232 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "name": "network-vif-plugged", "status": "completed", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] Creating event network-vif-plugged:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:19:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-46857b9e-dd77-4799-8646-2af3d7f7010b req-24c76675-32d1-4a9b-b66a-e0889666b949 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358047 Apr 11 23:19:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 240/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "name": "network-vif-plugged", "status": "completed", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}, {"name": "network-changed", "server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Creating event network-vif-plugged:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:19:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] Creating event network-changed:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:19:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ba8f528d-1cc5-4e6a-affe-41245f238387 req-722b6ab4-3d22-420d-bd9d-c7a9b3e08c35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050536 Apr 11 23:19:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 243/727] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "name": "network-vif-plugged", "status": "completed", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] Creating event network-vif-plugged:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:19:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-1b36f020-0c9e-4599-8c21-cfbfc77e1202 req-fe50fb15-5411-4c4e-a641-7716f191f0db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042147 Apr 11 23:19:15 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 245/728] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "name": "network-vif-plugged", "status": "completed", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:17 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] Creating event network-vif-plugged:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:19:17 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-8eb3faea-437c-4f69-b442-22e1d900f06a req-9587083a-143d-4fb8-bd23-6b29304f0262 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039264 Apr 11 23:19:17 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 241/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:18 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6e791132-2484-48b0-ae35-44b5ce6b3ee2 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 200 len: 1441 microversion: 2.1 time: 0.179686 Apr 11 23:19:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 244/730] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:18 2023] GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 1441 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=29 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5ce9f4-dab3-428c-876b-5d094b6122b5"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HTTP exception thrown: Cannot 'attach_volume' instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 while it is in vm_state rescued Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Request method failure captured: Apr 11 23:19:36 user devstack@n-api.service[61859]: request: POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/os-volume_attachments HTTP/1.1 Apr 11 23:19:36 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:19:36 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:19:36 user devstack@n-api.service[61859]: Connection: close Apr 11 23:19:36 user devstack@n-api.service[61859]: Content-Length: 74 Apr 11 23:19:36 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:19:36 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:19:36 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:19:36 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNel8YDw5kt-zpq9o8BfXzYVAkyOMAHnDdYxI6QSwDtEgCN_xUyvgVGy2uxbbzRjrWiU6O8aPkIHpu9_rAT7hib6dDYPTiVVTLHYU5rtoK_5bX3Ounh408ZugqO_NINUM4jpRmOpGl9fnqAkNwrO18UWBgCHszsJxigpTtffDM0gLxbg Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Project-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31c373270f804948a04c8125848fa181"}]}] Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Tenant-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-User: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:19:36 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:19:36 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:19:36 user devstack@n-api.service[61859]: X-User-Id: 8d63779eda794ef0b2413ac1483f88b8 Apr 11 23:19:36 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:19:36 user devstack@n-api.service[61859]: Apr 11 23:19:36 user devstack@n-api.service[61859]: {"volumeAttachment": {"volumeId": "be5ce9f4-dab3-428c-876b-5d094b6122b5"}} Apr 11 23:19:36 user devstack@n-api.service[61859]: method: > Apr 11 23:19:36 user devstack@n-api.service[61859]: exception: Cannot 'attach_volume' instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 while it is in vm_state rescued Apr 11 23:19:36 user devstack@n-api.service[61859]: action_args: {'server_id': 'dd8aa618-99bb-49d7-b547-e5db4470f4c6', 'body': {'volumeAttachment': {'volumeId': 'be5ce9f4-dab3-428c-876b-5d094b6122b5'}}} Apr 11 23:19:36 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 while it is in vm_state rescued Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 while it is in vm_state rescued Apr 11 23:19:36 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:19:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Returning 409 to user: Cannot 'attach_volume' instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 while it is in vm_state rescued {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:19:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4d6e259d-a374-48b3-8b6a-8ee606cab0e2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049437 Apr 11 23:19:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 246/731] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:19:36 2023] POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=5 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-bff5c5d3-dfe7-4394-81ab-c2ec6436a153 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/action" status: 202 len: 0 microversion: 2.1 time: 0.101405 Apr 11 23:19:36 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 242/732] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:19:36 2023] POST /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=9 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:36 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bcc784ec-bf93-47af-9545-456a11f749f9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1499 microversion: 2.1 time: 0.425457 Apr 11 23:19:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:36 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1499 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-unplugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] Creating event network-vif-unplugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:19:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-68e8023b-a24a-4122-b6d9-d3a8d692a234 req-9555686a-4d4e-4d75-894e-ebeebcebdcd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033806 Apr 11 23:19:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 247/734] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}, {"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:19:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:19:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-25b7f027-15a2-4c02-a8ed-88b77ee38b9c req-fe3d1a2d-c9f3-4cc0-ac01-337810fe0312 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030547 Apr 11 23:19:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 243/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:19:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-af7b85e9-9854-49d7-85a5-918193fb5782 req-33b99d3d-981b-4e24-94ef-135ec9bb8cd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053025 Apr 11 23:19:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 246/736] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:43 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:43 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-81c57959-b972-4cdc-b76d-d9c7c2bc7ae6 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1749 microversion: 2.1 time: 0.380373 Apr 11 23:19:43 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 248/737] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:43 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1749 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:51 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ea10d142-8175-4449-b8a4-43c94d9dcdae tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 200 len: 1542 microversion: 2.1 time: 0.341284 Apr 11 23:19:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 244/738] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:50 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:52 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61861) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 23:19:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-69652ce1-cf88-4971-8476-e07806783f4e tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/action" status: 202 len: 0 microversion: 2.1 time: 0.157692 Apr 11 23:19:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 247/739] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:19:52 2023] POST /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:52 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c74aba02-ad29-470b-9579-5589d55afcbe tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1506 microversion: 2.1 time: 0.233443 Apr 11 23:19:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 249/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:52 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:56 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:19:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-21e05508-a166-4a0b-a4fa-4f2fa061acc4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 200 len: 1537 microversion: 2.1 time: 0.155753 Apr 11 23:19:56 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 245/741] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:19:56 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:19:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:19:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:19:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:19:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:19:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] Creating event network-changed:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:19:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-61e18082-ee75-45bf-9b4b-acd4300163e3 req-a7e169b9-712f-4f28-b167-0994c2336113 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Apr 11 23:19:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 248/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:19:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bbbf8adf-7b8c-4836-a57d-2c0f07e88497 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 200 len: 1537 microversion: 2.1 time: 0.282439 Apr 11 23:20:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 250/743] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:00 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:20:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:20:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-13418d98-10a7-43f1-a9cb-8dde699dd819 req-18ea5c83-368e-44b5-b95c-53c80bf40a30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044769 Apr 11 23:20:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 246/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:20:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ea910d9a-cede-41c5-a633-bb939e1329a1 req-0c189f1f-99fe-455d-a529-069ff2559ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044193 Apr 11 23:20:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 249/745] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1726484212", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "69caf2c0-0a84-49e1-84cb-6be694771eff"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=11 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] validate_networks() for [('69caf2c0-0a84-49e1-84cb-6be694771eff', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=25 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Getting quotas for project 39bb15903c1c49fba14bf5e1c4a1556b. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Getting quotas for user 472822fb18a1486993fdfd21429a6823 and project 39bb15903c1c49fba14bf5e1c4a1556b. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:20:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:20:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c65cd26a-49a9-4db1-959a-0337d83ef63e tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.605846 Apr 11 23:20:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 251/746] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:20:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:20:06 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4c75c8bd-d0d4-4801-aa59-9365f78ed6ef tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:06 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4c75c8bd-d0d4-4801-aa59-9365f78ed6ef tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:06 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4c75c8bd-d0d4-4801-aa59-9365f78ed6ef tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472822fb18a1486993fdfd21429a6823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bb15903c1c49fba14bf5e1c4a1556b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4c75c8bd-d0d4-4801-aa59-9365f78ed6ef tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b" status: 200 len: 1208 microversion: 2.1 time: 0.087769 Apr 11 23:20:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 247/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:06 2023] GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:20:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] Creating event network-changed:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:20:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1fb59dd9-7383-4e85-a751-5fe9c82d0e7c req-9c0f1793-26c6-4b39-9af1-9e8edf7508a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031844 Apr 11 23:20:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 250/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "name": "network-vif-plugged", "status": "completed", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] Creating event network-vif-plugged:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:20:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-2f99446b-80f5-464d-8526-87b5523a6742 req-03a469d9-bdaa-4d09-a8ef-f73933ba1aa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031468 Apr 11 23:20:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 252/749] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "name": "network-vif-plugged", "status": "completed", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=14 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] Creating event network-vif-plugged:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:20:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-b6ef5577-d0f2-49f7-bf14-be32fafc7a3e req-5b69825e-c2b4-43c2-ae5e-8cb3c77cf913 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034978 Apr 11 23:20:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 248/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:19 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6257460b-8cb6-4d7a-bd10-b83b9e00e7a7 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 200 len: 1441 microversion: 2.1 time: 0.152302 Apr 11 23:20:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 251/751] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:18 2023] GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] Creating event network-changed:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:20:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-71eef4ac-2b5e-4401-a052-e1b96fb7fd5f req-957efdc5-ae8a-4f12-a1de-1cfd02b12743 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034792 Apr 11 23:20:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 253/752] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=13 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:20:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] Creating event network-changed:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:20:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fbc63cc1-84b9-4b6e-9bd0-7bea7590ca16 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 204 len: 0 microversion: 2.1 time: 0.128253 Apr 11 23:20:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 249/753] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:20:21 2023] DELETE /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:20:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-7afe89b0-c02e-4b33-b6b4-6a61f37bd9bd req-2a916361-961e-4dd0-8c9f-e3565b1aea49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129838 Apr 11 23:20:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 252/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:22 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e76dbbfe-7a31-4ebd-aa5c-96c513310832 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 200 len: 1566 microversion: 2.1 time: 0.196867 Apr 11 23:20:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 254/755] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:21 2023] GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:20:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "name": "network-vif-unplugged", "status": "completed", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}, {"server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "name": "network-vif-plugged", "status": "completed", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Creating event network-vif-unplugged:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:20:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] Creating event network-vif-plugged:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:20:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-43c39636-64bd-4782-837f-7b2476b0eb5b req-c781a333-96fd-4f5d-a10d-8c47bf81160f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.054936 Apr 11 23:20:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 250/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fabe62-030d-46f9-ba2f-0f484e987022", "name": "network-vif-deleted", "tag": "5602a828-929f-4fd6-bd61-f4d5717f6ca4"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] Creating event network-vif-deleted:5602a828-929f-4fd6-bd61-f4d5717f6ca4 for instance 90fabe62-030d-46f9-ba2f-0f484e987022 on user Apr 11 23:20:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e56c52b9-8b67-49b0-8885-1fd6fb760a44 req-2007a7c5-e04f-4c2a-b311-859065fe5620 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046280 Apr 11 23:20:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 253/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:27 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1826d6b8-195b-49e3-a528-a54da21f0183 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1505 microversion: 2.1 time: 0.145987 Apr 11 23:20:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 255/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:27 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:43 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-69554d0d-cebc-4c4d-9ff3-d9fed1353025 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1551 microversion: 2.1 time: 0.189213 Apr 11 23:20:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 251/759] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:42 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1551 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1323348752"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:44 user devstack@n-api.service[61861]: INFO nova.network.security_group_api [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Removing security group 36b2d468-146e-4961-b993-4b54a17756ff from port 86961f23-bd39-44da-8ad9-4420b80e9223 Apr 11 23:20:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e6ab35a2-6b32-4e10-9807-72b41ccc7b03 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.621832 Apr 11 23:20:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 254/760] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:20:43 2023] POST /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] Creating event network-changed:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:20:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b7c74028-0662-4162-a9a6-cacadfb64f0b req-80433436-1a47-4e12-855c-9a5f59a6dc41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035375 Apr 11 23:20:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 256/761] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:45 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:46 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'services' on Instance uuid 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:20:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5be67bab-1d70-47df-a11c-fac9ab292082 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments/5c7fe861-90c1-4630-a64a-73b40239df5e" status: 202 len: 0 microversion: 2.1 time: 0.171707 Apr 11 23:20:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:20:45 2023] DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments/5c7fe861-90c1-4630-a64a-73b40239df5e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5dece93c-58ab-4791-adb1-342f695583ae tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050114 Apr 11 23:20:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 255/763] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:20:46 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] Creating event network-changed:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:20:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-58029903-53d0-4e47-9169-e0bb0a8c887c req-58fcfe21-deec-4c8a-93bf-dfef158612a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028790 Apr 11 23:20:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 257/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3acd1e17-b148-4fb6-bc1e-2c314b0c8cb6 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.096738 Apr 11 23:20:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 253/765] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:20:51 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] Creating event network-changed:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:20:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-bc42a671-e744-47fb-a5c8-a5afaed9a0b2 req-5ea77294-8392-4597-9ee7-a6257d0bfff3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088530 Apr 11 23:20:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 256/766] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bdb35f3d-efe6-4576-a9c0-422e43226fe8 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/ips" status: 200 len: 106 microversion: 2.1 time: 0.037102 Apr 11 23:20:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 258/767] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:20:52 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/ips => generated 106 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4bbf528-5c40-4276-acce-e97fe84f22d3"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6c493dba-58a7-4747-8258-2aa44d0f9848 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280138 Apr 11 23:20:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 254/768] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:20:53 2023] POST /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9d042541-cb18-4542-83d6-cba09c6cddd1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.226636 Apr 11 23:20:56 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 257/769] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:20:56 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528/os-interface => generated 283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:57 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472822fb18a1486993fdfd21429a6823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bb15903c1c49fba14bf5e1c4a1556b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:20:57 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-61be582d-0306-414f-bdb8-595dc2640fc7 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b" status: 200 len: 1486 microversion: 2.1 time: 0.193508 Apr 11 23:20:57 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 259/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:20:57 2023] GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b => generated 1486 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:20:57 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:20:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:20:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:20:57 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:20:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] Creating event network-changed:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:20:57 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-71484521-328c-409d-86a6-c84af36ed4dc req-5a9348bc-30de-45ea-b3b9-a98fb907879b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Apr 11 23:20:57 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 255/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-865706147", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "f9e1c987-17bb-42a1-9005-96fcd25d79c0"}], "security_groups": [{"name": "tempest-securitygroup--1661352765"}], "key_name": "tempest-keypair-1554463927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "33464ef9-378a-4982-8601-296ed0c6bd35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] validate_networks() for [('f9e1c987-17bb-42a1-9005-96fcd25d79c0', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lazy-loading 'services' on Instance uuid bd78e8ee-ec6a-4de8-8146-bd37787b5c2c {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-80b1abaa-ca54-426d-9f5f-58fb479e28aa tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments/d4bbf528-5c40-4276-acce-e97fe84f22d3" status: 202 len: 0 microversion: 2.1 time: 0.175585 Apr 11 23:21:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 260/772] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:21:00 2023] DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments/d4bbf528-5c40-4276-acce-e97fe84f22d3 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-03ad8245-cde8-4d39-bfda-01f36d8e501d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050691 Apr 11 23:21:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 261/773] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:00 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:21:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4ff0735f-f1dc-47b1-bcd3-07cdf2268066 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100172 Apr 11 23:21:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 256/774] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:21:00 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:21:00 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33464ef9-378a-4982-8601-296ed0c6bd35',volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:21:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-b57d2c2d-992d-4bf0-a5b7-b866632e8fb6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.804052 Apr 11 23:21:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 258/775] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:21:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:21:01 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-29253bde-9618-420c-9746-cb55dc3ae50c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:01 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-29253bde-9618-420c-9746-cb55dc3ae50c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:01 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-29253bde-9618-420c-9746-cb55dc3ae50c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:01 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-29253bde-9618-420c-9746-cb55dc3ae50c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1075 microversion: 2.1 time: 0.118346 Apr 11 23:21:01 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 262/776] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:01 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1075 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] Creating event network-changed:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:21:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-af36befb-2298-4d4d-b6e3-56f72784ce28 req-8b146e9c-7c4f-49ab-9f1a-0642ed4a0782 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075672 Apr 11 23:21:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 257/777] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:21:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c8fca411-2df7-4b29-adf8-8b7b9aec8aaf tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/ips" status: 200 len: 104 microversion: 2.1 time: 0.038919 Apr 11 23:21:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 259/778] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:21:01 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/ips => generated 104 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c70b1197-3dde-4cbe-9034-c0e4dbf636ed"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:03 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-caeecfb1-4107-4dd0-9f65-7c762b449d93 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294106 Apr 11 23:21:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 263/779] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:21:03 2023] POST /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:03 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] Creating event network-changed:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:21:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-db7ea07e-b717-4d1f-a222-b5222ee4801a req-baac32c2-fb7f-46fc-afae-7cefd4400608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035228 Apr 11 23:21:03 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 258/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:21:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-bf3dcd89-0583-48a8-a16b-2d1cb0aba7e2 req-c298d496-202e-4ecf-badb-af36784005f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116722 Apr 11 23:21:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 260/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-29c34f72-fd09-4d85-8729-ddd9ded8b574 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048065 Apr 11 23:21:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 264/782] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:10 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-8f1077fe-8a5d-4450-87e6-db60e3294927 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed" status: 200 len: 194 microversion: 2.1 time: 0.051136 Apr 11 23:21:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 259/783] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 23:21:10 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:11 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:11 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:21:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5347465a-8c8a-4dcd-b487-264a87d3e338 req-d723018d-2834-41d6-8393-c4d902500c66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Apr 11 23:21:12 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 261/784] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 90fabe62-030d-46f9-ba2f-0f484e987022] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:21:12 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 HTTP/1.1 Apr 11 23:21:12 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:21:12 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:21:12 user devstack@n-api.service[61859]: Connection: close Apr 11 23:21:12 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:21:12 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:21:12 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:21:12 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:21:12 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:21:12 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:21:12 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:21:12 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:21:12 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:21:12 user devstack@n-api.service[61859]: method: > Apr 11 23:21:12 user devstack@n-api.service[61859]: exception: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. Apr 11 23:21:12 user devstack@n-api.service[61859]: action_args: {'id': '90fabe62-030d-46f9-ba2f-0f484e987022'} Apr 11 23:21:12 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. Apr 11 23:21:12 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:21:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 90fabe62-030d-46f9-ba2f-0f484e987022 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:21:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1730b2d1-0e15-4bcb-801c-7d374e4b0dfc tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022" status: 404 len: 111 microversion: 2.1 time: 0.031744 Apr 11 23:21:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 265/785] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:12 2023] GET /compute/v2.1/servers/90fabe62-030d-46f9-ba2f-0f484e987022 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25d580e-d90b-4acd-b6f2-3108fd4af2a7"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:12 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b941e604-3bc8-44ab-ab44-53a69030b0cc tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319656 Apr 11 23:21:12 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 260/786] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:21:12 2023] POST /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=23 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:15 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=28 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] Creating event network-changed:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:21:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b23e34b4-7cc3-4a00-8462-2753692aaf80 req-ca94380e-5fad-4268-a6b6-c52b67f3610a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038334 Apr 11 23:21:15 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 266/787] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:15 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:21:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4a03a5e9-ea03-4021-8311-9d80ae6fcbbf tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 204 len: 0 microversion: 2.1 time: 0.218023 Apr 11 23:21:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 262/788] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:21:15 2023] DELETE /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=21 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:15 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589c07cd12e849cfa38423959e76c695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6700d66136e4f9590658e3103cceac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-14944650-b237-4602-8852-4821ff04d9c4 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 200 len: 1565 microversion: 2.1 time: 0.247268 Apr 11 23:21:15 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 261/789] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:15 2023] GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:21:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "name": "network-vif-deleted", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:17 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] Creating event network-vif-deleted:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:21:17 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-54f831f7-4f59-4b1f-ab42-75a7f9dc1985 req-51be5126-2d83-419f-9dcd-b6c50bb54c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Apr 11 23:21:17 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 267/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}, {"server_uuid": "f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f", "name": "network-vif-plugged", "status": "completed", "tag": "251c2317-e6a3-40d8-849b-bec8357be943"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Creating event network-vif-unplugged:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:21:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] Creating event network-vif-plugged:251c2317-e6a3-40d8-849b-bec8357be943 for instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f on user Apr 11 23:21:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d74b2fb8-fadf-4653-b3e1-23f1ec7f132d req-0debec30-e358-4623-8de2-075e68876ed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.040610 Apr 11 23:21:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 263/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b3ac33be-5995-4768-a3b1-be891c9bb01a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047917 Apr 11 23:21:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 262/792] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:20 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7887e96a-b1cc-4197-9eaf-59eb559afb0c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed" status: 200 len: 194 microversion: 2.1 time: 0.045640 Apr 11 23:21:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 268/793] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 23:21:20 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:20 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'services' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:21:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-46db71cd-af0c-4c5b-8162-a8aab5072adb tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed" status: 202 len: 0 microversion: 2.1 time: 0.170598 Apr 11 23:21:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 264/794] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:21:20 2023] DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/c70b1197-3dde-4cbe-9034-c0e4dbf636ed => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-860620da-ba0f-4032-9ad8-4a224566a31c tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/a25d580e-d90b-4acd-b6f2-3108fd4af2a7" status: 200 len: 194 microversion: 2.1 time: 0.078801 Apr 11 23:21:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 263/795] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 23:21:22 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/a25d580e-d90b-4acd-b6f2-3108fd4af2a7 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:23 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lazy-loading 'services' on Instance uuid 5014e85f-b341-4d4d-83f9-6641ee426a46 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:21:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b22759a2-3640-46fc-b39e-83efaceb1cec tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/a25d580e-d90b-4acd-b6f2-3108fd4af2a7" status: 202 len: 0 microversion: 2.1 time: 0.264560 Apr 11 23:21:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 269/796] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:21:22 2023] DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments/a25d580e-d90b-4acd-b6f2-3108fd4af2a7 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-b8b7f0ff-2894-4ae7-8768-49eb3d8e42d2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047284 Apr 11 23:21:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:25 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-138c5e2d-9a4d-4e01-8087-88895dc9614a tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043181 Apr 11 23:21:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 264/798] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:25 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:21:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b8addbc3-1018-4193-8df8-d760d8552c83 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 204 len: 0 microversion: 2.1 time: 0.108190 Apr 11 23:21:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 270/799] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:21:25 2023] DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:26 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1793cec543e8425899474614b2c10f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ff3d48596a44f8ac8d9306becd8178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-213548a4-28de-44e9-a60f-5ed681307680 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 200 len: 1661 microversion: 2.1 time: 0.174223 Apr 11 23:21:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:25 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 1661 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "name": "network-vif-unplugged", "status": "completed", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] Creating event network-vif-unplugged:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:21:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-6642fb36-d6f1-4b3e-bf52-3513515e3ffe req-33709f11-3b9b-45c2-a7e9-0f021ff5feea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040212 Apr 11 23:21:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 265/801] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:28 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "name": "network-vif-plugged", "status": "completed", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}, {"server_uuid": "5014e85f-b341-4d4d-83f9-6641ee426a46", "name": "network-vif-deleted", "tag": "484a65b3-2e3e-4c0c-8035-c002575411ba"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Creating event network-vif-plugged:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:21:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] Creating event network-vif-deleted:484a65b3-2e3e-4c0c-8035-c002575411ba for instance 5014e85f-b341-4d4d-83f9-6641ee426a46 on user Apr 11 23:21:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b4ed9267-7059-42b4-8ff2-6769e228c12e req-078ec1e3-2d44-445f-85bd-292b6dbd839b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032540 Apr 11 23:21:28 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 271/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-dfad832f-4bd5-4ee5-b916-d6f677e801ea tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: .version_select at 0x7f31347e7490>, body: {"keypair": {"name": "tempest-keypair-1207488062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrGcGiE4e6Tp38+exR5YT3oDXkSl1ZsauX2FXZ9tTkUu/HLi16m9tlHlzQu5NVP1uorNPN1lADTpqYHlQH1A6/c0JnTeih3uliLzgAEFHnvGzYHnPpZKyFHC5IeclDOHA=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:28 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-dfad832f-4bd5-4ee5-b916-d6f677e801ea tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for project 31c373270f804948a04c8125848fa181. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:21:28 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-dfad832f-4bd5-4ee5-b916-d6f677e801ea tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for user 8d63779eda794ef0b2413ac1483f88b8 and project 31c373270f804948a04c8125848fa181. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:21:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-dfad832f-4bd5-4ee5-b916-d6f677e801ea tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047431 Apr 11 23:21:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 267/803] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:21:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1543973671", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c17359e-31c1-483d-a0cd-920c089c1405"}], "security_groups": [{"name": "tempest-securitygroup--684626195"}], "key_name": "tempest-keypair-1207488062", "user_data": "}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] validate_networks() for [('4c17359e-31c1-483d-a0cd-920c089c1405', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Getting quotas for user 8d63779eda794ef0b2413ac1483f88b8 and project 31c373270f804948a04c8125848fa181. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:21:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:21:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ceee5ebb-2c68-422e-b592-8d3675d1e9fe tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.618389 Apr 11 23:21:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 266/804] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:21:30 2023] POST /compute/v2.1/servers => generated 406 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:21:30 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5b8b90ce-aa39-4ef7-b567-d21c7e4119a7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:30 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5b8b90ce-aa39-4ef7-b567-d21c7e4119a7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-5b8b90ce-aa39-4ef7-b567-d21c7e4119a7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5b8b90ce-aa39-4ef7-b567-d21c7e4119a7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1240 microversion: 2.1 time: 0.062034 Apr 11 23:21:30 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 272/805] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:30 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1240 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:33 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] Creating event network-changed:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:21:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9ce956b2-ec7e-4adf-8bd8-9b97abbf94a1 req-9b3df501-ab1a-487c-b878-32facfbe8112 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Apr 11 23:21:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 268/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:21:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-7646a11c-811d-4462-b01a-6c6b3b5c72f0 req-415f9748-9987-4ee3-b570-2bfd49cd4c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Apr 11 23:21:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 267/807] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-750584eb-5232-4363-bfe8-232de4d741eb tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045750 Apr 11 23:21:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 273/808] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:36 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HTTP exception thrown: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c is not attached to volume 5c7fe861-90c1-4630-a64a-73b40239df5e Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Request method failure captured: Apr 11 23:21:36 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments/5c7fe861-90c1-4630-a64a-73b40239df5e HTTP/1.1 Apr 11 23:21:36 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:21:36 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:21:36 user devstack@n-api.service[61861]: Connection: close Apr 11 23:21:36 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:21:36 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:21:36 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:21:36 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:21:36 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNepTmYSlq1FIKMYTKVRpUNKuGZgfOckyGhfOJmjVJrEdGEf4m69FWqB59dM0a-2nn7eTXWCSzvk239gPpaeC_MJkmJQzi4d_ptv2xR-lWkmTTD2elIQKzVzkTiwgCGDJEgvPgADrVpUZQh1KbbpqdmWwy7BwtMv4XPNbSQlAGIV9MDA Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Project-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e8e126b69d44b27a60c421b86b79e9f"}]}] Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Tenant: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Tenant-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:21:36 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:21:36 user devstack@n-api.service[61861]: X-User: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:21:36 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:21:36 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:21:36 user devstack@n-api.service[61861]: X-User-Id: 6beb3cae81a14fa2bae48a8eedcb3868 Apr 11 23:21:36 user devstack@n-api.service[61861]: X-User-Name: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:21:36 user devstack@n-api.service[61861]: method: > Apr 11 23:21:36 user devstack@n-api.service[61861]: exception: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c is not attached to volume 5c7fe861-90c1-4630-a64a-73b40239df5e Apr 11 23:21:36 user devstack@n-api.service[61861]: action_args: {'server_id': '1fec2e5a-e0bf-435d-822b-766c8c2f2d9c', 'id': '5c7fe861-90c1-4630-a64a-73b40239df5e'} Apr 11 23:21:36 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c7fe861-90c1-4630-a64a-73b40239df5e. Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c is not attached to volume 5c7fe861-90c1-4630-a64a-73b40239df5e Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c is not attached to volume 5c7fe861-90c1-4630-a64a-73b40239df5e Apr 11 23:21:36 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:21:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Returning 404 to user: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c is not attached to volume 5c7fe861-90c1-4630-a64a-73b40239df5e {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:21:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-55bab981-46af-44a3-8d05-d63d76116e7b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments/5c7fe861-90c1-4630-a64a-73b40239df5e" status: 404 len: 154 microversion: 2.1 time: 0.111995 Apr 11 23:21:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 269/809] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:21:36 2023] DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c/os-volume_attachments/5c7fe861-90c1-4630-a64a-73b40239df5e => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:21:37 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:21:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-65233097-e7c3-4970-bda2-0231fb571fc9 req-6a18050b-84bf-4ae1-b644-cbdb1bce9b8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042648 Apr 11 23:21:37 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 268/810] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:38 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:21:38 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a7c1138f-6801-43e8-94a0-4f0e425ceb6d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 204 len: 0 microversion: 2.1 time: 0.122322 Apr 11 23:21:38 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 274/811] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:21:38 2023] DELETE /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:38 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:38 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-cd13c284-d1d8-4c55-a448-6ea0f87644dc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 200 len: 1543 microversion: 2.1 time: 0.251780 Apr 11 23:21:38 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 270/812] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:38 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 1543 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] Creating event network-vif-unplugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:21:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-e5786168-6c1a-4fc3-b0e4-22e532b39507 req-30564b7d-5794-4890-907b-996fe043448d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062011 Apr 11 23:21:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 269/813] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-plugged", "status": "completed", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}, {"server_uuid": "1fec2e5a-e0bf-435d-822b-766c8c2f2d9c", "name": "network-vif-deleted", "tag": "86961f23-bd39-44da-8ad9-4420b80e9223"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:41 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Creating event network-vif-plugged:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:21:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] Creating event network-vif-deleted:86961f23-bd39-44da-8ad9-4420b80e9223 for instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c on user Apr 11 23:21:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-7913313c-fcf6-4290-aeb3-d8c9f7c9eb48 req-4741d357-c55e-40b1-8ee4-b0c0473495b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033681 Apr 11 23:21:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 275/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:44 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] Creating event network-changed:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:21:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9634b836-2d6b-457f-a1f6-69d225436a36 req-90018217-f300-4780-a9f4-b05afa912863 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033876 Apr 11 23:21:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 270/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0f40b103-936a-4267-acd8-cfc28df70c9f tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 204 len: 0 microversion: 2.1 time: 0.132064 Apr 11 23:21:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:21:44 2023] DELETE /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfb7fc33f4e4694bcc224292ac5f231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3252362661dd4f8c9ad6298048a84c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b54d94c6-09f9-430a-a028-24d808e66a8b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 200 len: 1557 microversion: 2.1 time: 0.229265 Apr 11 23:21:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 276/817] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:44 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-unplugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] Creating event network-vif-unplugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:21:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-f4ac8bf1-bc34-464a-9ed3-56a8eb04a20e req-9e4b4777-0126-44a4-81d7-769833123d20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032099 Apr 11 23:21:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 271/818] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-deleted", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:46 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] Creating event network-vif-deleted:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:21:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5b765d22-f6ee-4123-8f04-82b3d416e007 req-08760e54-9320-48c2-b3d0-2bcc370f19c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039334 Apr 11 23:21:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 272/819] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9f6a0d-caab-4f42-a9b1-a4653b90559f", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8ff97-1370-4a98-8111-ac1c6635a9ee"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:46 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] Creating event network-vif-plugged:5bd8ff97-1370-4a98-8111-ac1c6635a9ee for instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f on user Apr 11 23:21:47 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d052e9b7-e6bc-4f93-a37e-bae405c7a3c9 req-bcc5146f-fe2a-4b6b-8765-a16fd7db8c2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Apr 11 23:21:47 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 277/820] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=38 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:21:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-67362368-4411-41ca-a3f4-3e4ccdbfbb6d tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048716 Apr 11 23:21:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 272/821] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:21:50 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:21:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-41bdd44d-e823-4664-b373-dfeba3f5a178 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 204 len: 0 microversion: 2.1 time: 0.119814 Apr 11 23:21:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 273/822] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:21:50 2023] DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:51 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da1389f3e27f49f394598636d041a9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f29d28c472c4f65b8437ce443d208c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-d1e4de28-5a68-4f59-aa7e-c083bcdfc0e4 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 200 len: 1667 microversion: 2.1 time: 0.207438 Apr 11 23:21:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 278/823] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:50 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 1667 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:51 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:21:51 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4e9e6797-420a-414e-af13-f28f01f8b061 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1427 microversion: 2.1 time: 0.420349 Apr 11 23:21:51 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 273/824] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:21:51 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1427 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:21:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-unplugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] Creating event network-vif-unplugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-7fb49c68-87b5-457e-9108-27bce87443e5 req-3e82bf9f-f6bf-4090-aa02-4e918ad3d4f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052324 Apr 11 23:21:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-deleted", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] Creating event network-vif-deleted:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0eff57ab-9de6-47fb-8810-e981201f974e req-7379182f-b3a4-47c3-bd9a-f96d50d3b845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037831 Apr 11 23:21:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 279/826] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:21:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}, {"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}, {"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}, {"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-unplugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}, {"server_uuid": "bd78e8ee-ec6a-4de8-8146-bd37787b5c2c", "name": "network-vif-plugged", "status": "completed", "tag": "79f30c94-ec16-4a33-b97e-639ce9a383c8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:21:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:21:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:21:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Creating event network-vif-unplugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] Creating event network-vif-plugged:79f30c94-ec16-4a33-b97e-639ce9a383c8 for instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c on user Apr 11 23:21:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ed7720fd-36c6-418f-91d5-920ea37f61f2 req-fa9bc181-e277-4af7-a6a1-7b71290141ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036900 Apr 11 23:21:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 274/827] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:02 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:22:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-100121a1-79bc-4803-990f-6822a7fc3702 tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b" status: 204 len: 0 microversion: 2.1 time: 0.128675 Apr 11 23:22:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:02 2023] DELETE /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:02 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472822fb18a1486993fdfd21429a6823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bb15903c1c49fba14bf5e1c4a1556b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4ee1f68d-6605-4d28-99a1-0768592d7dec tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b" status: 200 len: 1492 microversion: 2.1 time: 0.251715 Apr 11 23:22:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 280/829] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:02 2023] GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b => generated 1492 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:22:02 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "name": "network-vif-unplugged", "status": "completed", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:02 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] Creating event network-vif-unplugged:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:22:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-845a6343-0d88-4d32-b4d0-2ae6fae5c21e req-22d8179e-9e62-481d-a52f-308a50821726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035306 Apr 11 23:22:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 275/830] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "name": "network-vif-deleted", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] Creating event network-vif-deleted:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:22:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-4dd41077-a902-4a45-9fcd-079b6bfc95ca req-807fee91-4e02-4ad9-97a0-291e542d3e5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Apr 11 23:22:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 276/831] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b007f35d-b7e1-401f-8b11-37eda193e79b", "name": "network-vif-plugged", "status": "completed", "tag": "7a39b637-85b5-46da-b7f4-1754f2f38325"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] Creating event network-vif-plugged:7a39b637-85b5-46da-b7f4-1754f2f38325 for instance b007f35d-b7e1-401f-8b11-37eda193e79b on user Apr 11 23:22:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-03be2c5d-f318-4d31-98aa-b92e1e76fbba req-ed612ca3-157f-45b9-bd15-3883537f25f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027689 Apr 11 23:22:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 281/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:22:05 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f HTTP/1.1 Apr 11 23:22:05 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:05 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:05 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:05 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:05 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:05 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:05 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:05 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:05 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:05 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:05 user devstack@n-api.service[61860]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:22:05 user devstack@n-api.service[61860]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:05 user devstack@n-api.service[61860]: method: > Apr 11 23:22:05 user devstack@n-api.service[61860]: exception: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. Apr 11 23:22:05 user devstack@n-api.service[61860]: action_args: {'id': 'f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f'} Apr 11 23:22:05 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. Apr 11 23:22:05 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:05 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:05 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ab6f7f37-78cc-4e03-82e5-22d35ccf40d5 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f" status: 404 len: 111 microversion: 2.1 time: 0.137269 Apr 11 23:22:05 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 276/833] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:05 2023] GET /compute/v2.1/servers/f0cd4aaf-7da8-4fb6-973c-b668a6ba3e2f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:22:06 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b HTTP/1.1 Apr 11 23:22:06 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:06 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:06 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:06 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:06 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:06 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:06 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:06 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:06 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:06 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:06 user devstack@n-api.service[61861]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:22:06 user devstack@n-api.service[61861]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:06 user devstack@n-api.service[61861]: method: > Apr 11 23:22:06 user devstack@n-api.service[61861]: exception: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61861]: action_args: {'id': '29cf3139-d486-40da-8ab9-e695e5fd539b'} Apr 11 23:22:06 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-59938fac-c64a-4c78-ab87-e10226b2f4b0 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 404 len: 111 microversion: 2.1 time: 0.032958 Apr 11 23:22:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:06 2023] DELETE /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] [instance: 29cf3139-d486-40da-8ab9-e695e5fd539b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] HTTP exception thrown: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Request method failure captured: Apr 11 23:22:06 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b HTTP/1.1 Apr 11 23:22:06 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:06 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:06 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:06 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:06 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:06 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:06 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:06 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeenuTE-Ge3IAWC9ZHyIFLVu3oA6bIA3FTYKvfTtrsXHKJtZV6HOObW0IMhiP2dFWqZHVzBc1s_2WqnnliHlL0iT9AkI-lj8IgwMQ13IvS8gqDOUrqzHPz_2QwO2uifOY63iHgzd_Hb_4SGmUxpo1tNZ_leUVC-Kw0a5L4r1EK3haDM Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Project-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f6700d66136e4f9590658e3103cceac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f6700d66136e4f9590658e3103cceac8"}]}] Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Tenant: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Tenant-Id: f6700d66136e4f9590658e3103cceac8 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestVolumeBootPattern-365588456 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-User: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:06 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:06 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:06 user devstack@n-api.service[61859]: X-User-Id: 589c07cd12e849cfa38423959e76c695 Apr 11 23:22:06 user devstack@n-api.service[61859]: X-User-Name: tempest-TestVolumeBootPattern-365588456-project-member Apr 11 23:22:06 user devstack@n-api.service[61859]: method: > Apr 11 23:22:06 user devstack@n-api.service[61859]: exception: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61859]: action_args: {'id': '29cf3139-d486-40da-8ab9-e695e5fd539b'} Apr 11 23:22:06 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. Apr 11 23:22:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Returning 404 to user: Instance 29cf3139-d486-40da-8ab9-e695e5fd539b could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9b706fc4-e660-4f5a-b8f7-d195f9388400 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b" status: 404 len: 111 microversion: 2.1 time: 0.027012 Apr 11 23:22:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 282/835] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:06 2023] GET /compute/v2.1/servers/29cf3139-d486-40da-8ab9-e695e5fd539b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-be6131d9-f43b-4a47-a185-a86d9cd51063 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] Calling method '.version_select at 0x7f3157728a60>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-be6131d9-f43b-4a47-a185-a86d9cd51063 tempest-TestVolumeBootPattern-365588456 tempest-TestVolumeBootPattern-365588456-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-15540354" status: 202 len: 0 microversion: 2.1 time: 0.087122 Apr 11 23:22:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 277/836] 10.0.0.210 () {62 vars in 1334 bytes} [Tue Apr 11 23:22:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-15540354 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:22:16 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 HTTP/1.1 Apr 11 23:22:16 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:16 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:16 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:16 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:16 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:16 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:16 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:16 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:16 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:16 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:16 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:16 user devstack@n-api.service[61861]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:22:16 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:16 user devstack@n-api.service[61861]: method: > Apr 11 23:22:16 user devstack@n-api.service[61861]: exception: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:16 user devstack@n-api.service[61861]: action_args: {'id': '5014e85f-b341-4d4d-83f9-6641ee426a46'} Apr 11 23:22:16 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9584433b-2443-4763-9551-0fa6363f4c9d tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 404 len: 111 microversion: 2.1 time: 0.032495 Apr 11 23:22:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 278/837] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:16 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:16 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5b593103-9574-41e0-b90e-ded8509310f2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '.version_select at 0x7f315785f7f0>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5b593103-9574-41e0-b90e-ded8509310f2 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733576032" status: 202 len: 0 microversion: 2.1 time: 0.025024 Apr 11 23:22:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 283/838] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:22:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733576032 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=17 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:20 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-cb667008-3e26-4cda-9be3-aa4aa4829194 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1554 microversion: 2.1 time: 0.213981 Apr 11 23:22:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 278/839] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:20 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:22:21 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 HTTP/1.1 Apr 11 23:22:21 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:21 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:21 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:21 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:21 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:21 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:21 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:21 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:21 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:21 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:21 user devstack@n-api.service[61861]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:22:21 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:21 user devstack@n-api.service[61861]: method: > Apr 11 23:22:21 user devstack@n-api.service[61861]: exception: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61861]: action_args: {'id': '5014e85f-b341-4d4d-83f9-6641ee426a46'} Apr 11 23:22:21 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e3b5bcb9-4d82-4684-81dc-4b34533f96b0 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 404 len: 111 microversion: 2.1 time: 0.031082 Apr 11 23:22:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 279/840] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:21 2023] DELETE /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=19 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: 5014e85f-b341-4d4d-83f9-6641ee426a46] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:22:21 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 HTTP/1.1 Apr 11 23:22:21 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:21 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:21 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:21 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:21 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:21 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:21 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:21 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:21 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:21 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:21 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:21 user devstack@n-api.service[61859]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:22:21 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:21 user devstack@n-api.service[61859]: method: > Apr 11 23:22:21 user devstack@n-api.service[61859]: exception: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61859]: action_args: {'id': '5014e85f-b341-4d4d-83f9-6641ee426a46'} Apr 11 23:22:21 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. Apr 11 23:22:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance 5014e85f-b341-4d4d-83f9-6641ee426a46 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1d34f1a2-eaaf-47b2-b712-41708596d32f tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46" status: 404 len: 111 microversion: 2.1 time: 0.036406 Apr 11 23:22:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 284/841] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:21 2023] GET /compute/v2.1/servers/5014e85f-b341-4d4d-83f9-6641ee426a46 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:22:23 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 HTTP/1.1 Apr 11 23:22:23 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:23 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:23 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:23 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:23 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:23 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:23 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:23 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:23 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:23 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:23 user devstack@n-api.service[61860]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:22:23 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:23 user devstack@n-api.service[61860]: method: > Apr 11 23:22:23 user devstack@n-api.service[61860]: exception: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61860]: action_args: {'id': 'e4d31874-4273-48bc-8811-89832d18b893'} Apr 11 23:22:23 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fd563327-e044-427c-9496-a38585a5a3ad tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 404 len: 111 microversion: 2.1 time: 0.057101 Apr 11 23:22:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 279/842] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:23 2023] DELETE /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] [instance: e4d31874-4273-48bc-8811-89832d18b893] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] HTTP exception thrown: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Request method failure captured: Apr 11 23:22:23 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 HTTP/1.1 Apr 11 23:22:23 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:23 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:23 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:23 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:23 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:23 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:23 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:23 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh98RaTza7UAy5KZ5iJbYzkJKl_u3fUVB3QcW3-y-QQatQU33mIUDTx6odmYtHp1VAK91w06JC6bCXCRipA8vR1SIEH240K3SepuyFxlQEKpaZBPUy_pM2rcQFR5RdrYGefjiixOh-onwSuFlxiZ5ThdSN0pe2auG5udMy6eFYvuxw Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Project-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ff3d48596a44f8ac8d9306becd8178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ff3d48596a44f8ac8d9306becd8178"}]}] Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Tenant-Id: f0ff3d48596a44f8ac8d9306becd8178 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-343820803 Apr 11 23:22:23 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:23 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:23 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:23 user devstack@n-api.service[61861]: X-User-Id: 1793cec543e8425899474614b2c10f5d Apr 11 23:22:23 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeTestJSON-343820803-project-member Apr 11 23:22:23 user devstack@n-api.service[61861]: method: > Apr 11 23:22:23 user devstack@n-api.service[61861]: exception: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61861]: action_args: {'id': 'e4d31874-4273-48bc-8811-89832d18b893'} Apr 11 23:22:23 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. Apr 11 23:22:23 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] Returning 404 to user: Instance e4d31874-4273-48bc-8811-89832d18b893 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-17cc10f2-c214-45b4-a991-37ccc9401044 tempest-AttachVolumeTestJSON-343820803 tempest-AttachVolumeTestJSON-343820803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893" status: 404 len: 111 microversion: 2.1 time: 0.096968 Apr 11 23:22:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 280/843] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:23 2023] GET /compute/v2.1/servers/e4d31874-4273-48bc-8811-89832d18b893 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HTTP exception thrown: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Request method failure captured: Apr 11 23:22:29 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c HTTP/1.1 Apr 11 23:22:29 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:29 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:29 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:29 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:29 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:29 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:29 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:29 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNepTmYSlq1FIKMYTKVRpUNKuGZgfOckyGhfOJmjVJrEdGEf4m69FWqB59dM0a-2nn7eTXWCSzvk239gPpaeC_MJkmJQzi4d_ptv2xR-lWkmTTD2elIQKzVzkTiwgCGDJEgvPgADrVpUZQh1KbbpqdmWwy7BwtMv4XPNbSQlAGIV9MDA Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Project-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e8e126b69d44b27a60c421b86b79e9f"}]}] Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Tenant: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Tenant-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:22:29 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:22:29 user devstack@n-api.service[61859]: X-User: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:22:29 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:29 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:29 user devstack@n-api.service[61859]: X-User-Id: 6beb3cae81a14fa2bae48a8eedcb3868 Apr 11 23:22:29 user devstack@n-api.service[61859]: X-User-Name: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:22:29 user devstack@n-api.service[61859]: method: > Apr 11 23:22:29 user devstack@n-api.service[61859]: exception: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. Apr 11 23:22:29 user devstack@n-api.service[61859]: action_args: {'id': '1fec2e5a-e0bf-435d-822b-766c8c2f2d9c'} Apr 11 23:22:29 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. Apr 11 23:22:29 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Returning 404 to user: Instance 1fec2e5a-e0bf-435d-822b-766c8c2f2d9c could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:29 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e647cfe1-6a54-4704-9ce6-2c156fb1e9ba tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c" status: 404 len: 111 microversion: 2.1 time: 0.198958 Apr 11 23:22:29 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 285/844] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:28 2023] GET /compute/v2.1/servers/1fec2e5a-e0bf-435d-822b-766c8c2f2d9c => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:29 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a3d3de8e-1271-4772-9fb3-b45ccf8f2824 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '.version_select at 0x7f31578a9870>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:29 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a3d3de8e-1271-4772-9fb3-b45ccf8f2824 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1640213672" status: 202 len: 0 microversion: 2.1 time: 0.025911 Apr 11 23:22:29 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 280/845] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 23:22:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1640213672 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:31 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2bdebb5a-9d86-4ab6-b6e9-679938acac11 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: .version_select at 0x7f31346909d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-838126683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQqGH/kfWyycJV+rfaP6s9LvyHbrOQOqj3ecif3osUput5uwLfhlAG3RPK68uUvF8LN/jHw+/aOHG438K/C3fo0khReoBztMDo8d2EyfaVQ8avg/fYrCuq6mMAW4+vi2g=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:31 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-2bdebb5a-9d86-4ab6-b6e9-679938acac11 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:22:31 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-2bdebb5a-9d86-4ab6-b6e9-679938acac11 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for user 6beb3cae81a14fa2bae48a8eedcb3868 and project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:22:31 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2bdebb5a-9d86-4ab6-b6e9-679938acac11 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.076823 Apr 11 23:22:31 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 281/846] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:22:31 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:22:31 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-142160481", "imageRef": "b43563e6-41a8-46f2-9c35-b9e64b84f9cf", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-838126683", "networks": [{"uuid": "12bc1283-756b-41da-93c1-09d86844d45d"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:31 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] validate_networks() for [('12bc1283-756b-41da-93c1-09d86844d45d', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Getting quotas for user 6beb3cae81a14fa2bae48a8eedcb3868 and project 9e8e126b69d44b27a60c421b86b79e9f. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:22:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b43563e6-41a8-46f2-9c35-b9e64b84f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:22:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c29cb996-6c81-4864-9cf2-77c5d730967b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.597118 Apr 11 23:22:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 286/847] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:22:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:22:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5846aeac-cbe9-4c26-b0e2-0da4baa70f6b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5846aeac-cbe9-4c26-b0e2-0da4baa70f6b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:32 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-5846aeac-cbe9-4c26-b0e2-0da4baa70f6b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5846aeac-cbe9-4c26-b0e2-0da4baa70f6b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1251 microversion: 2.1 time: 0.085939 Apr 11 23:22:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 281/848] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:32 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1251 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] [instance: 8d9f6a0d-caab-4f42-a9b1-a4653b90559f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] HTTP exception thrown: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Request method failure captured: Apr 11 23:22:34 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f HTTP/1.1 Apr 11 23:22:34 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:34 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:34 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:34 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:34 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:34 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:34 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:34 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeotcK_vznIf-wLFyRicGhuWNvX15cvYBzj-VJ35E7EP8i2-7Jihll3ZHIh473itPBGi8Bg-tod5AwbhVgv7IPhe2TGKFctezUZXkI4KeyHfhxy39hHAUMIE7eWALhFqq2DvKRjlPVHFVRUP8innpOr7H276lNEZ24Rip69iGrnlW9k Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Project-Id: 3252362661dd4f8c9ad6298048a84c6a Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestShelveInstance-932398179 Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3252362661dd4f8c9ad6298048a84c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3252362661dd4f8c9ad6298048a84c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3252362661dd4f8c9ad6298048a84c6a"}]}] Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Tenant: tempest-TestShelveInstance-932398179 Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Tenant-Id: 3252362661dd4f8c9ad6298048a84c6a Apr 11 23:22:34 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestShelveInstance-932398179 Apr 11 23:22:34 user devstack@n-api.service[61861]: X-User: tempest-TestShelveInstance-932398179-project-member Apr 11 23:22:34 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:34 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:34 user devstack@n-api.service[61861]: X-User-Id: acfb7fc33f4e4694bcc224292ac5f231 Apr 11 23:22:34 user devstack@n-api.service[61861]: X-User-Name: tempest-TestShelveInstance-932398179-project-member Apr 11 23:22:34 user devstack@n-api.service[61861]: method: > Apr 11 23:22:34 user devstack@n-api.service[61861]: exception: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. Apr 11 23:22:34 user devstack@n-api.service[61861]: action_args: {'id': '8d9f6a0d-caab-4f42-a9b1-a4653b90559f'} Apr 11 23:22:34 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. Apr 11 23:22:34 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Returning 404 to user: Instance 8d9f6a0d-caab-4f42-a9b1-a4653b90559f could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-495d2186-96a2-4157-a87c-b8965f8c250b tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f" status: 404 len: 111 microversion: 2.1 time: 0.046262 Apr 11 23:22:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 282/849] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:34 2023] GET /compute/v2.1/servers/8d9f6a0d-caab-4f42-a9b1-a4653b90559f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ca73dbff-62b6-457a-9a2a-27faafc3adb0 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] Calling method '.version_select at 0x7f315774fe20>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ca73dbff-62b6-457a-9a2a-27faafc3adb0 tempest-TestShelveInstance-932398179 tempest-TestShelveInstance-932398179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1561116455" status: 202 len: 0 microversion: 2.1 time: 0.026847 Apr 11 23:22:35 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 287/850] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 23:22:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1561116455 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] Creating event network-changed:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:22:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-90c53f4b-9593-4f98-9f56-2252eaf0db45 req-7474ddbc-91a2-4898-bf59-5eeef11ffdd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036102 Apr 11 23:22:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 282/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:37 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:22:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-706be35b-7b04-40e7-abdd-41f8ed417615 req-4c8e6f44-c1fa-4399-a1c5-3489daadc2a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043215 Apr 11 23:22:37 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 283/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:39 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:22:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-a267c970-3a8d-4d58-b761-127e05d7f97f req-5664b1da-5a08-4bfa-912f-81b7730bcf19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055066 Apr 11 23:22:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 288/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:41 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c HTTP/1.1 Apr 11 23:22:41 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:41 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:41 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:41 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:41 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:41 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:41 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:41 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:41 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:41 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:41 user devstack@n-api.service[61860]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:41 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:41 user devstack@n-api.service[61860]: method: > Apr 11 23:22:41 user devstack@n-api.service[61860]: exception: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:41 user devstack@n-api.service[61860]: action_args: {'id': 'bd78e8ee-ec6a-4de8-8146-bd37787b5c2c'} Apr 11 23:22:41 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:41 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:41 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:41 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-31a6c374-ce2e-4faf-906f-0e0344966009 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 404 len: 111 microversion: 2.1 time: 0.046530 Apr 11 23:22:41 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 283/854] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:41 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-af9be649-5e9d-40fb-bd94-c5edf12dfb40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '.version_select at 0x7f3134776d40>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-af9be649-5e9d-40fb-bd94-c5edf12dfb40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508967452" status: 202 len: 0 microversion: 2.1 time: 0.025723 Apr 11 23:22:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 284/855] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:22:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508967452 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:44 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c HTTP/1.1 Apr 11 23:22:44 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:44 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:44 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:44 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:44 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:44 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:44 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:44 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:44 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:44 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:44 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:44 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:44 user devstack@n-api.service[61859]: method: > Apr 11 23:22:44 user devstack@n-api.service[61859]: exception: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61859]: action_args: {'id': 'bd78e8ee-ec6a-4de8-8146-bd37787b5c2c'} Apr 11 23:22:44 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c6c30094-010d-4151-90b0-aa9320dd4871 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 404 len: 111 microversion: 2.1 time: 0.036156 Apr 11 23:22:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 289/856] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:44 2023] DELETE /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: bd78e8ee-ec6a-4de8-8146-bd37787b5c2c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:44 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c HTTP/1.1 Apr 11 23:22:44 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:44 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:44 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:44 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:44 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:44 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:44 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:44 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:44 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:44 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:44 user devstack@n-api.service[61860]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:44 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:44 user devstack@n-api.service[61860]: method: > Apr 11 23:22:44 user devstack@n-api.service[61860]: exception: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61860]: action_args: {'id': 'bd78e8ee-ec6a-4de8-8146-bd37787b5c2c'} Apr 11 23:22:44 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. Apr 11 23:22:44 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance bd78e8ee-ec6a-4de8-8146-bd37787b5c2c could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e1023e30-f483-41bf-b8e2-193708998ecb tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c" status: 404 len: 111 microversion: 2.1 time: 0.033854 Apr 11 23:22:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 284/857] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:44 2023] GET /compute/v2.1/servers/bd78e8ee-ec6a-4de8-8146-bd37787b5c2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:46 user devstack@n-api.service[61861]: request: DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 HTTP/1.1 Apr 11 23:22:46 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:46 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:46 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:46 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:46 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:46 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:46 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:46 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61861]: method: > Apr 11 23:22:46 user devstack@n-api.service[61861]: exception: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: action_args: {'id': 'f1a98583-cd58-4078-999f-f2bfb3a50c48'} Apr 11 23:22:46 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a6c39532-74ad-4a4d-b555-ee85df882e17 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 404 len: 111 microversion: 2.1 time: 0.033116 Apr 11 23:22:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 285/858] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:46 2023] DELETE /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f1a98583-cd58-4078-999f-f2bfb3a50c48] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:46 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 HTTP/1.1 Apr 11 23:22:46 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:46 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:46 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:46 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:46 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:46 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:46 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:46 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:46 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61859]: method: > Apr 11 23:22:46 user devstack@n-api.service[61859]: exception: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61859]: action_args: {'id': 'f1a98583-cd58-4078-999f-f2bfb3a50c48'} Apr 11 23:22:46 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. Apr 11 23:22:46 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f1a98583-cd58-4078-999f-f2bfb3a50c48 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-ecc765c1-f9ba-4c24-a468-206fb553880e tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48" status: 404 len: 111 microversion: 2.1 time: 0.028646 Apr 11 23:22:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 290/859] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:46 2023] GET /compute/v2.1/servers/f1a98583-cd58-4078-999f-f2bfb3a50c48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:46 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b HTTP/1.1 Apr 11 23:22:46 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:46 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:46 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:46 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:46 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:46 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:46 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:46 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61860]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:46 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61860]: method: > Apr 11 23:22:46 user devstack@n-api.service[61860]: exception: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61860]: action_args: {'id': 'f2f6794f-cdcf-422e-8ae5-030fc2c3213b'} Apr 11 23:22:46 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-dfc1533c-eb75-4d86-a734-f9ce3ab467d2 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 404 len: 111 microversion: 2.1 time: 0.031936 Apr 11 23:22:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 285/860] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:46 2023] DELETE /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2f6794f-cdcf-422e-8ae5-030fc2c3213b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:46 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b HTTP/1.1 Apr 11 23:22:46 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:22:46 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:22:46 user devstack@n-api.service[61861]: Connection: close Apr 11 23:22:46 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:22:46 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:22:46 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:22:46 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:22:46 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:46 user devstack@n-api.service[61861]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:46 user devstack@n-api.service[61861]: method: > Apr 11 23:22:46 user devstack@n-api.service[61861]: exception: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: action_args: {'id': 'f2f6794f-cdcf-422e-8ae5-030fc2c3213b'} Apr 11 23:22:46 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. Apr 11 23:22:46 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:22:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2f6794f-cdcf-422e-8ae5-030fc2c3213b could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4f13c9cf-d42b-4c4a-a179-2852c95a5e40 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b" status: 404 len: 111 microversion: 2.1 time: 0.038307 Apr 11 23:22:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 286/861] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:46 2023] GET /compute/v2.1/servers/f2f6794f-cdcf-422e-8ae5-030fc2c3213b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:49 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d HTTP/1.1 Apr 11 23:22:49 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:49 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:49 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:49 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:49 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:49 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:49 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:49 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:49 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:49 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:49 user devstack@n-api.service[61859]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:49 user devstack@n-api.service[61859]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:49 user devstack@n-api.service[61859]: method: > Apr 11 23:22:49 user devstack@n-api.service[61859]: exception: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61859]: action_args: {'id': 'f2a79a44-800e-4142-b778-aae06a5c779d'} Apr 11 23:22:49 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-967a0ecf-6944-4b39-9001-908f90ee3694 tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 404 len: 111 microversion: 2.1 time: 0.033801 Apr 11 23:22:49 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 291/862] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:22:48 2023] DELETE /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] [instance: f2a79a44-800e-4142-b778-aae06a5c779d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] HTTP exception thrown: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Request method failure captured: Apr 11 23:22:49 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d HTTP/1.1 Apr 11 23:22:49 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:22:49 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:22:49 user devstack@n-api.service[61860]: Connection: close Apr 11 23:22:49 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:22:49 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:22:49 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:22:49 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:22:49 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNeh6gChcR4irkV0wiIEudswm9LXF5za_Ouk71CuOwg_b_ugpKZm7jo33DhznGztLZ-XXRkCGzTCrEa1PMEKhcuieZ6q5OlJTDrlGsXNBdym5-LGoQVClYyVMrOLhR80phRCP3YicKty0OrfiukMQkQ-C9SKtf5e9vqYKCKq0bFlcEAc Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Project-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Project-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9f29d28c472c4f65b8437ce443d208c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9f29d28c472c4f65b8437ce443d208c7"}]}] Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Tenant: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Tenant-Id: 9f29d28c472c4f65b8437ce443d208c7 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2123485934 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-User: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:49 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:22:49 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:22:49 user devstack@n-api.service[61860]: X-User-Id: da1389f3e27f49f394598636d041a9c9 Apr 11 23:22:49 user devstack@n-api.service[61860]: X-User-Name: tempest-AttachVolumeNegativeTest-2123485934-project-member Apr 11 23:22:49 user devstack@n-api.service[61860]: method: > Apr 11 23:22:49 user devstack@n-api.service[61860]: exception: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61860]: action_args: {'id': 'f2a79a44-800e-4142-b778-aae06a5c779d'} Apr 11 23:22:49 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. Apr 11 23:22:49 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:22:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] Returning 404 to user: Instance f2a79a44-800e-4142-b778-aae06a5c779d could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0652392b-6aca-4c8f-847f-f78b3ce230de tempest-AttachVolumeNegativeTest-2123485934 tempest-AttachVolumeNegativeTest-2123485934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d" status: 404 len: 111 microversion: 2.1 time: 0.038427 Apr 11 23:22:49 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 286/863] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:49 2023] GET /compute/v2.1/servers/f2a79a44-800e-4142-b778-aae06a5c779d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-45a3cbc4-2acf-4875-ac0e-597a7ad24b94 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.180234 Apr 11 23:22:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 287/864] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:22:51 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] [instance: b007f35d-b7e1-401f-8b11-37eda193e79b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=15 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] HTTP exception thrown: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Request method failure captured: Apr 11 23:22:52 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b HTTP/1.1 Apr 11 23:22:52 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:22:52 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:22:52 user devstack@n-api.service[61859]: Connection: close Apr 11 23:22:52 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:22:52 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:22:52 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:22:52 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:22:52 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNeskrFa5i8dQcei6SZn7S2KNfZTpFsg7ay3Y-83zL3D1t3HVOc0-yt1laf-HYnvnU90UsBju59Co0cOGjKN9OKRB6xlzLB5f5GTkn4u1PCliGiQvu9pGejvqf_4wBHcP_6mCGjpVUA1R8HAfn6PvsPlhPGpc9UWisasCwzMauCh-AJ0 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Project-Id: 39bb15903c1c49fba14bf5e1c4a1556b Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesActionsTest-1880276817 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39bb15903c1c49fba14bf5e1c4a1556b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39bb15903c1c49fba14bf5e1c4a1556b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39bb15903c1c49fba14bf5e1c4a1556b"}]}] Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesActionsTest-1880276817 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Tenant-Id: 39bb15903c1c49fba14bf5e1c4a1556b Apr 11 23:22:52 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesActionsTest-1880276817 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-User: tempest-VolumesActionsTest-1880276817-project-member Apr 11 23:22:52 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:22:52 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:22:52 user devstack@n-api.service[61859]: X-User-Id: 472822fb18a1486993fdfd21429a6823 Apr 11 23:22:52 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesActionsTest-1880276817-project-member Apr 11 23:22:52 user devstack@n-api.service[61859]: method: > Apr 11 23:22:52 user devstack@n-api.service[61859]: exception: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. Apr 11 23:22:52 user devstack@n-api.service[61859]: action_args: {'id': 'b007f35d-b7e1-401f-8b11-37eda193e79b'} Apr 11 23:22:52 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. Apr 11 23:22:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:22:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] Returning 404 to user: Instance b007f35d-b7e1-401f-8b11-37eda193e79b could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:22:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5e5499a0-1149-4432-b5ca-2471d284802f tempest-VolumesActionsTest-1880276817 tempest-VolumesActionsTest-1880276817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b" status: 404 len: 111 microversion: 2.1 time: 0.046574 Apr 11 23:22:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 292/865] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:52 2023] GET /compute/v2.1/servers/b007f35d-b7e1-401f-8b11-37eda193e79b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:22:53 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:53 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:22:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:53 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] Creating event network-changed:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:22:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2eeccc76-215d-4ec9-97a8-ccf42e501ae9 req-ae71c038-e412-4935-a308-e1b39ffad0ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040127 Apr 11 23:22:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 287/866] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0e997f9d-ca6d-42be-bc57-4df94f5c4cc3 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1427 microversion: 2.1 time: 0.282579 Apr 11 23:22:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 288/867] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:53 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1427 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Old instance type m1.nano, new instance type m1.micro {{(pid=61859) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Getting quotas for user ddc7eb14e7174babb8680b4020243c97 and project 2fca37343b414de6b008ad79e022f858. Resources: {'cores', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:22:54 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:22:54 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-00418a55-c6f2-4ddb-8925-745999fa484a tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action" status: 202 len: 0 microversion: 2.1 time: 0.319558 Apr 11 23:22:54 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 293/868] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:22:54 2023] POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:54 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:22:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7fe05e27-cbb6-4f63-8d9d-40bab9b166aa tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1436 microversion: 2.1 time: 0.234238 Apr 11 23:22:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 288/869] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:22:54 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1436 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:22:55 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:55 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] Creating event network-changed:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:22:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-687731e9-b8c0-41f3-9fa1-4ae5f1bb9528 req-29ea52a3-4216-413e-8b84-11b9b989cac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040475 Apr 11 23:22:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 289/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:22:57 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-unplugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:22:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:22:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:22:57 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:22:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Creating event network-vif-unplugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:22:58 user devstack@n-api.service[61859]: DEBUG nova.compute.api [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] Instance de7744d0-487a-49be-9355-fcf1266af37f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:22:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b375d772-569e-44bb-b837-a4126e0e5c26 req-f14a1d99-ca21-4d7a-9772-dbffe956331d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.237587 Apr 11 23:22:58 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 294/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:22:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:23:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] Instance de7744d0-487a-49be-9355-fcf1266af37f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:23:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ee9ed3f8-cd69-4c6f-bd08-a6380160cb71 req-eb18895c-c734-4b36-a6f2-c1a14b67dfce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052460 Apr 11 23:23:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 289/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:02 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-69938484-b88d-49f1-bd14-21ded685b130 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: .version_select at 0x7f31347e68c0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1460777543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUWUtLbTKq+AUj8Uy8O9tvOBWgBrtL+o/73ozA9TTO3DvBRE/6oeST9X/TTWUygilmTDxs/k1hBTXhyEfya0gLgVki/2ncujtXGZV/qXtTHa0+XA4KdKMeiJChGGgeDMQ=="}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:02 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-69938484-b88d-49f1-bd14-21ded685b130 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting quotas for project 2af1370fd8e646d0a5066c42dff5b30f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:23:02 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-69938484-b88d-49f1-bd14-21ded685b130 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting quotas for user e0ebfdb379f540188693c63f74c9ad68 and project 2af1370fd8e646d0a5066c42dff5b30f. Resources: {'key_pairs'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:23:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-69938484-b88d-49f1-bd14-21ded685b130 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.239690 Apr 11 23:23:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 290/873] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:23:02 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1711417485", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1460777543", "security_groups": [{"name": "tempest-secgroup-smoke-1200098104"}], "networks": [{"uuid": "76b0a0b7-401f-44e6-ace6-bac4e29c0ec4"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] validate_networks() for [('76b0a0b7-401f-44e6-ace6-bac4e29c0ec4', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting quotas for project 2af1370fd8e646d0a5066c42dff5b30f. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Getting quotas for user e0ebfdb379f540188693c63f74c9ad68 and project 2af1370fd8e646d0a5066c42dff5b30f. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:23:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:23:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c4d617c4-1f02-4fc0-9cb6-8a7224eac48f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.666424 Apr 11 23:23:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 295/874] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:23:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:23:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4d005e03-642d-47ad-8fdc-11582eb6d362 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4d005e03-642d-47ad-8fdc-11582eb6d362 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:04 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4d005e03-642d-47ad-8fdc-11582eb6d362 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ebfdb379f540188693c63f74c9ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af1370fd8e646d0a5066c42dff5b30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:23:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4d005e03-642d-47ad-8fdc-11582eb6d362 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 200 len: 1257 microversion: 2.1 time: 0.086606 Apr 11 23:23:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 290/875] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:23:04 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 1257 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=20 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] Creating event network-changed:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:23:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-f929d4b7-d45f-45b3-8416-3390c521a311 req-29fb445b-3207-4110-aa8d-82e5f3bb0e00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044743 Apr 11 23:23:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 291/876] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:23:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] Instance de7744d0-487a-49be-9355-fcf1266af37f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:23:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b8aefc33-4582-4531-875f-730770e3b488 req-ed2e0733-c5e9-4105-b771-fa04056a4064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066889 Apr 11 23:23:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 296/877] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=22 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:23:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-d07198e8-b7d4-4641-b5ef-bed2770d5240 req-7c23578d-08ac-4eea-9d1c-77e929b56f45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050619 Apr 11 23:23:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 291/878] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:12 user devstack@n-api.service[61861]: DEBUG nova.compute.api [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] Instance de7744d0-487a-49be-9355-fcf1266af37f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61861) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 23:23:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-0046bffd-1fc6-4f7b-8aea-6f87189435e3 req-2ab8c510-c026-42a1-9962-10bc0484f200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058413 Apr 11 23:23:12 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 292/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:23:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-324d521f-8d40-4b62-98b1-3fe3f55fb415 req-f2742c67-4f47-41d4-9a1c-185739d3b2de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Apr 11 23:23:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 297/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=11 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-335c60c5-963c-4cc1-ab73-f36fef3456ed tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.113118 Apr 11 23:23:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 292/881] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:23:21 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-interface => generated 283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] Creating event network-changed:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1f08d738-0394-4f39-af11-a498c1688ad4 req-0188fc95-1d3b-4be4-8769-5bf6a48b2c71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075170 Apr 11 23:23:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 293/882] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c77b710-e771-4ae0-a61f-30aea1088f14"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:22 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:23:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f9187f71-95fd-4f22-a823-386c9a5fff9d tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1535 microversion: 2.1 time: 0.260192 Apr 11 23:23:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 298/883] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:23:22 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1535 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:23:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ea7db139-4cb1-45e7-940b-3e6d71c0104d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502998 Apr 11 23:23:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 293/884] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:23:22 2023] POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:30 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'flavor' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:23:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9f0031c1-10e4-4727-a265-d872ac8d170b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/action" status: 200 len: 32 microversion: 2.1 time: 0.168861 Apr 11 23:23:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 294/885] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:23:30 2023] POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:30 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:31 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:31 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:31 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:23:31 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e26e2abc-7a4d-4ce2-8a7d-5409f91550e4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1725 microversion: 2.1 time: 0.200857 Apr 11 23:23:31 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 299/886] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:23:30 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:23:31 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-unplugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:31 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] Creating event network-vif-unplugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:23:31 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-6f2137bd-e980-493e-b4ba-3839e3fad797 req-118475cd-e2fc-4c44-9c5c-d9e6e9462aa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045849 Apr 11 23:23:31 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 294/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:33 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:23:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-177fe378-bdc9-419d-a193-02cff8ad9b31 req-c4f1df00-ca3d-4dfb-be4d-b2820d2a9931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037049 Apr 11 23:23:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 295/888] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}, {"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:23:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:23:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:23:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-942fefe7-5037-4b29-a701-9dd83b3ef4e3 req-7095117a-7483-4830-8173-0a548525a47e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033040 Apr 11 23:23:35 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 300/889] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:44 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:23:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0208ac2b-3c68-4019-9493-2a46cd0be1e5 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1554 microversion: 2.1 time: 0.172372 Apr 11 23:23:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 295/890] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:23:44 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:23:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ebfdb379f540188693c63f74c9ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af1370fd8e646d0a5066c42dff5b30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:23:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-37df3dba-4609-4355-bc9e-ecdbf31d6133 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 200 len: 1570 microversion: 2.1 time: 0.211361 Apr 11 23:23:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 296/891] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:23:54 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=7 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:21 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-077f0dae-ca31-4eb2-8d5b-ef38ac40c444 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1705 microversion: 2.1 time: 0.423068 Apr 11 23:24:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 301/892] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:21 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1705 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:23 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-dc9345ed-bf41-4771-9287-b552f39f5d55 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1535 microversion: 2.1 time: 0.228461 Apr 11 23:24:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 296/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:22 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1535 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Searching by: {'deleted': False, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f'} {{(pid=61861) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:23 user devstack@n-api.service[61861]: DEBUG nova.compute.multi_cell_list [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61861) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 23:24:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-12756d47-b276-4b32-85ae-7ffee579fb68 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.319397 Apr 11 23:24:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 297/894] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 23:24:23 2023] GET /compute/v2.1/servers => generated 340 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-771ca6a6-cdac-43b5-ab59-fed4e0947e32 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1535 microversion: 2.1 time: 0.206155 Apr 11 23:24:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 302/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:23 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1535 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-08a833a3-cebf-44ea-b70c-f01e496604a4 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285550 Apr 11 23:24:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 297/896] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:24:25 2023] POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:32 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:32 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-f09bc47f-7d12-403e-a1ba-6573ebdeaec0 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1581 microversion: 2.1 time: 0.172315 Apr 11 23:24:32 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 298/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:32 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1581 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=12 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:33 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] Creating event network-changed:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-efee6351-ffbb-4aa0-bf88-5320932c71a9 req-2b9ec466-6316-4cf6-be85-b18a293a5029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034157 Apr 11 23:24:33 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 303/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1383245853"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:35 user devstack@n-api.service[61860]: INFO nova.network.security_group_api [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Adding security group 60519a28-57f5-4e57-ba2d-70181f632961 to port 6198de25-d537-4d39-ad81-b8af63bed69e Apr 11 23:24:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9dd71210-60fb-4666-a986-8b4ffb3fac78 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action" status: 202 len: 0 microversion: 2.1 time: 0.591334 Apr 11 23:24:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 298/899] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:24:35 2023] POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:35 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:35 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c5061de8-f757-46c2-b224-e4361c45455c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1746 microversion: 2.1 time: 0.209862 Apr 11 23:24:35 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 299/900] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:35 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] Creating event network-changed:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-379d1d70-4ab5-4b7a-9716-2c55bb61a4da req-25ea813e-dbe1-434b-a6d0-b9aaa969266a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041265 Apr 11 23:24:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 304/901] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:36 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-311184de-683e-4748-b7f3-efd59de4a7bc tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action" status: 202 len: 0 microversion: 2.1 time: 0.108087 Apr 11 23:24:36 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 299/902] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:24:36 2023] POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:36 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-44f991fb-d20d-4435-9adc-e913fad64ece tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1738 microversion: 2.1 time: 0.266163 Apr 11 23:24:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 300/903] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:36 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:24:39 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-unplugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] Creating event network-vif-unplugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-25a9e270-3a92-43ad-bf60-f0d9254a45ff req-3ae9b40a-d217-41c2-b590-f46fdbe95981 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050958 Apr 11 23:24:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 305/904] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:42 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}, {"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}, {"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:42 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:24:42 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-189745b3-2a32-42f7-8b03-0f7a628923c7 req-df257414-bea7-4169-94ba-6313aa35e1a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034559 Apr 11 23:24:42 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 300/905] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:24:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:45 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-ae03f750-5d77-410f-a703-db4805b1d487 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action" status: 204 len: 0 microversion: 2.1 time: 0.078534 Apr 11 23:24:45 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 301/906] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:24:44 2023] POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:45 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:45 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e4e80242-f35a-489b-8443-1783130fa0e4 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1554 microversion: 2.1 time: 0.238143 Apr 11 23:24:45 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 306/907] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:45 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=10 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:55 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ebfdb379f540188693c63f74c9ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af1370fd8e646d0a5066c42dff5b30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:24:55 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0acd8d3b-13f1-4339-bebe-8bc368a63b26 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 200 len: 1570 microversion: 2.1 time: 0.219164 Apr 11 23:24:55 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 301/908] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:24:55 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=10 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] Creating event network-changed:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:24:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-5c840871-6ad1-4eca-a90a-f12726709faf req-6f18cb3a-71bf-463f-9649-406655e811f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043834 Apr 11 23:24:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 302/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:24:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b99c36-512f-42e1-a9f6-a59e284daf4c"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=12 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:24:58 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:24:58 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-75c17441-232b-412b-a798-864c4ead0f3d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279042 Apr 11 23:24:58 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 307/910] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:24:58 2023] POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:10 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'services' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:25:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d7022a72-ea99-44d1-befc-54ff209e495e tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/60b99c36-512f-42e1-a9f6-a59e284daf4c" status: 202 len: 0 microversion: 2.1 time: 0.177552 Apr 11 23:25:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 302/911] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:25:10 2023] DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/60b99c36-512f-42e1-a9f6-a59e284daf4c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:11 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2e91a704-39ca-42c1-8637-c85db2037615 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.321922 Apr 11 23:25:11 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 303/912] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:25:10 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 197 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 546a073f-3860-4aea-9da5-713d87a3762e while it is in vm_state rescued Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Request method failure captured: Apr 11 23:25:21 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments/3c77b710-e771-4ae0-a61f-30aea1088f14 HTTP/1.1 Apr 11 23:25:21 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:25:21 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:25:21 user devstack@n-api.service[61859]: Connection: close Apr 11 23:25:21 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:25:21 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:25:21 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:25:21 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:25:21 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNel8YDw5kt-zpq9o8BfXzYVAkyOMAHnDdYxI6QSwDtEgCN_xUyvgVGy2uxbbzRjrWiU6O8aPkIHpu9_rAT7hib6dDYPTiVVTLHYU5rtoK_5bX3Ounh408ZugqO_NINUM4jpRmOpGl9fnqAkNwrO18UWBgCHszsJxigpTtffDM0gLxbg Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Project-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31c373270f804948a04c8125848fa181"}]}] Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Tenant-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-User: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:25:21 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:25:21 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:25:21 user devstack@n-api.service[61859]: X-User-Id: 8d63779eda794ef0b2413ac1483f88b8 Apr 11 23:25:21 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:25:21 user devstack@n-api.service[61859]: method: > Apr 11 23:25:21 user devstack@n-api.service[61859]: exception: Cannot 'detach_volume' instance 546a073f-3860-4aea-9da5-713d87a3762e while it is in vm_state rescued Apr 11 23:25:21 user devstack@n-api.service[61859]: action_args: {'server_id': '546a073f-3860-4aea-9da5-713d87a3762e', 'id': '3c77b710-e771-4ae0-a61f-30aea1088f14'} Apr 11 23:25:21 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 546a073f-3860-4aea-9da5-713d87a3762e in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 546a073f-3860-4aea-9da5-713d87a3762e while it is in vm_state rescued Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 546a073f-3860-4aea-9da5-713d87a3762e while it is in vm_state rescued Apr 11 23:25:21 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:25:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Returning 409 to user: Cannot 'detach_volume' instance 546a073f-3860-4aea-9da5-713d87a3762e while it is in vm_state rescued {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:25:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-90de54cf-dbc5-4987-9ceb-6f7fd1c976f8 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments/3c77b710-e771-4ae0-a61f-30aea1088f14" status: 409 len: 152 microversion: 2.1 time: 0.101453 Apr 11 23:25:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 308/913] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:25:21 2023] DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments/3c77b710-e771-4ae0-a61f-30aea1088f14 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b3312bb7-d16d-4ba0-a12f-43eda22da615 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/action" status: 202 len: 0 microversion: 2.1 time: 0.094129 Apr 11 23:25:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 303/914] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:25:21 2023] POST /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:25:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:25:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-4803213e-717f-46a6-acce-ae7ae3db365d tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1713 microversion: 2.1 time: 0.298724 Apr 11 23:25:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 304/915] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:25:21 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1713 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:25:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-unplugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:25:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] Creating event network-vif-unplugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:25:22 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-fede98c8-cd50-4452-af7d-cd44299ea94b req-38342dd5-e38c-4e20-a685-cb9b5f19ed63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029205 Apr 11 23:25:22 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 309/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:25:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:25:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:25:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-cc11c456-ae39-44b0-b04f-7e858a19b2db req-15ba96f7-76f5-4a39-8844-f9be1643134b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030432 Apr 11 23:25:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 304/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:26 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:25:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a82ee5d9-156f-4efe-8d04-d2bb9484673e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1746 microversion: 2.1 time: 0.156948 Apr 11 23:25:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 305/918] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:25:26 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:25:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}, {"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:25:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:25:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:25:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-f934a8aa-79d5-407e-98db-11d833c42439 req-c36ba5c2-ec5e-4429-97e9-e1d4dd2a7ccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031183 Apr 11 23:25:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 310/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:25:35 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:25:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eaed577c-3adc-4ad3-a84a-f8250e42735f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1546 microversion: 2.1 time: 0.203420 Apr 11 23:25:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 305/920] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:25:35 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:26:01 user devstack@n-api.service[61861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:01 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:01 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d1042073-9ddd-48a3-abf5-cd29b508cdeb tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048809 Apr 11 23:26:01 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:26:01 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=10 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a841378f-78ee-4221-810f-51e451ff84ac"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:03 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e9e1158a-c030-4be2-88a5-5a7559d03d9b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297864 Apr 11 23:26:03 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 311/922] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:26:02 2023] POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:09 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'services' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:26:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ebb71566-88f9-45aa-ac3c-9371dbb1078d tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/a841378f-78ee-4221-810f-51e451ff84ac" status: 202 len: 0 microversion: 2.1 time: 0.182112 Apr 11 23:26:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 306/923] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:26:09 2023] DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/a841378f-78ee-4221-810f-51e451ff84ac => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:10 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42984. Apr 11 23:26:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a20fd4eb-919d-4774-b23c-180b6cc53457 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074865 Apr 11 23:26:10 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 307/924] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:26:10 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:12 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:26:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-179475ce-73e5-4f05-af6f-97b3936a899c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1719 microversion: 2.1 time: 0.148569 Apr 11 23:26:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 312/925] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:26:12 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1383245853"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:26 user devstack@n-api.service[61860]: INFO nova.network.security_group_api [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Removing security group 60519a28-57f5-4e57-ba2d-70181f632961 from port 6198de25-d537-4d39-ad81-b8af63bed69e Apr 11 23:26:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a5ed1cac-df61-4fa0-bc6d-ad17998ffb7c tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action" status: 202 len: 0 microversion: 2.1 time: 0.988561 Apr 11 23:26:27 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 307/926] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:26:26 2023] POST /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] Creating event network-changed:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:26:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-28202cd8-a4ad-4e50-8c9e-6c43b39f8321 req-8af834c8-9664-43de-8edf-e3c032a52ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145124 Apr 11 23:26:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 308/927] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:26:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:28 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:26:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:28 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] Creating event network-changed:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:26:28 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lazy-loading 'services' on Instance uuid 70323493-f9fa-49e5-a363-b34b9b8907a1 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:26:28 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-d7d19b85-9019-4aaf-addc-0d799976322e req-5e4999e3-158b-4873-ab50-4e9bd3bc7be2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094135 Apr 11 23:26:28 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 308/928] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:26:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:26:28 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-50b0c8f7-3990-47d7-ac91-82dc4dd0088e tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments/78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf" status: 202 len: 0 microversion: 2.1 time: 0.164180 Apr 11 23:26:28 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 313/929] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:26:28 2023] DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments/78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c7657d4d-dfc7-45cf-82d8-9983b1a9c2f5 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050319 Apr 11 23:26:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 309/930] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:26:28 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:35 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:26:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-de02b019-6bc3-4098-9e6e-c54eb3e5ba84 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1546 microversion: 2.1 time: 0.326273 Apr 11 23:26:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 309/931] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:26:35 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1546 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:26:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:36 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0f7246d4-bc4c-4334-b80d-4f2b42108635 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action" status: 200 len: 28253 microversion: 2.1 time: 0.217873 Apr 11 23:26:36 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 314/932] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:26:35 2023] POST /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f/action => generated 28253 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:26:36 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:26:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bd57e018-d94d-438e-952a-9ef035897ee0 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 200 len: 1537 microversion: 2.1 time: 0.443531 Apr 11 23:26:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 310/933] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:26:36 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 1537 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-011ac7e6-4c61-4cb7-b69d-7d0d5e464d31 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051205 Apr 11 23:27:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 310/934] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:27:00 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "876f4485-cc3f-4c6e-b387-563ec9619806"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:01 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-a0be12d1-e318-4ff6-af5c-4e90581b3941 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290364 Apr 11 23:27:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 315/935] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:27:01 2023] POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=14 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:08 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'services' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:27:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-044c67f5-964d-48f6-b0b4-1e75f0c60b62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/876f4485-cc3f-4c6e-b387-563ec9619806" status: 202 len: 0 microversion: 2.1 time: 0.218313 Apr 11 23:27:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 311/936] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:27:08 2023] DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/876f4485-cc3f-4c6e-b387-563ec9619806 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-350d8ff4-7a83-4dc5-8440-ed97c6fa0d89 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062573 Apr 11 23:27:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 311/937] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:27:09 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7730b28f-afba-4957-8ffd-cde634f88679 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.111947 Apr 11 23:27:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 316/938] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 23:27:12 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-interface => generated 283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:13 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:13 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] Creating event network-changed:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:27:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-7895dd95-2fea-46c8-b137-fb22039cc02a req-9432cffc-7f7a-4d1b-92c7-01af6e44a2d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080921 Apr 11 23:27:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 312/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:13 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lazy-loading 'services' on Instance uuid 546a073f-3860-4aea-9da5-713d87a3762e {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:27:14 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5f06103a-8d12-45fd-93eb-8b204b8f2d2b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments/3c77b710-e771-4ae0-a61f-30aea1088f14" status: 202 len: 0 microversion: 2.1 time: 0.236179 Apr 11 23:27:14 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 312/940] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:27:13 2023] DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments/3c77b710-e771-4ae0-a61f-30aea1088f14 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:14 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:14 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-0604580e-43a2-408d-bb76-111ee7500d3b tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059007 Apr 11 23:27:14 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 317/941] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:27:14 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] Creating event network-changed:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:27:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d4b398a3-b6ca-41a9-91b0-372253434ded req-bf3004ff-1261-45aa-8f48-45d948460b59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029750 Apr 11 23:27:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 313/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:18 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-3b991df4-905d-4a88-b431-489e1d5748c9 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048620 Apr 11 23:27:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 313/943] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:27:18 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HTTP exception thrown: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 is not attached to volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf Apr 11 23:27:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Request method failure captured: Apr 11 23:27:19 user devstack@n-api.service[61859]: request: DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments/78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf HTTP/1.1 Apr 11 23:27:19 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:27:19 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:27:19 user devstack@n-api.service[61859]: Connection: close Apr 11 23:27:19 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:27:19 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:27:19 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:27:19 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:27:19 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNepTmYSlq1FIKMYTKVRpUNKuGZgfOckyGhfOJmjVJrEdGEf4m69FWqB59dM0a-2nn7eTXWCSzvk239gPpaeC_MJkmJQzi4d_ptv2xR-lWkmTTD2elIQKzVzkTiwgCGDJEgvPgADrVpUZQh1KbbpqdmWwy7BwtMv4XPNbSQlAGIV9MDA Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Project-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e8e126b69d44b27a60c421b86b79e9f"}]}] Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Tenant: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Tenant-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:27:19 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:27:19 user devstack@n-api.service[61859]: X-User: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:27:19 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:27:19 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:27:19 user devstack@n-api.service[61859]: X-User-Id: 6beb3cae81a14fa2bae48a8eedcb3868 Apr 11 23:27:19 user devstack@n-api.service[61859]: X-User-Name: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:27:19 user devstack@n-api.service[61859]: method: > Apr 11 23:27:19 user devstack@n-api.service[61859]: exception: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 is not attached to volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf Apr 11 23:27:19 user devstack@n-api.service[61859]: action_args: {'server_id': '70323493-f9fa-49e5-a363-b34b9b8907a1', 'id': '78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf'} Apr 11 23:27:19 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf. Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 is not attached to volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 is not attached to volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf Apr 11 23:27:19 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:27:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Returning 404 to user: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 is not attached to volume 78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:27:19 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5c5e1d3e-d55b-42f0-aac0-fdb0c2d4ad86 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments/78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf" status: 404 len: 154 microversion: 2.1 time: 0.099737 Apr 11 23:27:19 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 318/944] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:27:18 2023] DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1/os-volume_attachments/78b3bc92-fdd6-4dd0-973d-c07b9b4f8cdf => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:27:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-38cfe00b-c624-4eff-8d4a-a53be079326b tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 204 len: 0 microversion: 2.1 time: 0.117499 Apr 11 23:27:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 314/945] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:27:21 2023] DELETE /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:21 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb3cae81a14fa2bae48a8eedcb3868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e126b69d44b27a60c421b86b79e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:27:21 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9cd83938-b2e5-4ed1-8d0a-b52444775227 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 200 len: 1541 microversion: 2.1 time: 0.182435 Apr 11 23:27:21 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 314/946] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:27:21 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 1541 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:27:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-unplugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] Creating event network-vif-unplugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:27:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-fd8216be-aa4d-49fd-912f-364acb3211fc req-a90ca45f-663a-4de3-a57d-2702deb416f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040847 Apr 11 23:27:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 319/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-plugged", "status": "completed", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}, {"server_uuid": "70323493-f9fa-49e5-a363-b34b9b8907a1", "name": "network-vif-deleted", "tag": "6198de25-d537-4d39-ad81-b8af63bed69e"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Creating event network-vif-plugged:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:27:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] Creating event network-vif-deleted:6198de25-d537-4d39-ad81-b8af63bed69e for instance 70323493-f9fa-49e5-a363-b34b9b8907a1 on user Apr 11 23:27:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-120bf3ae-bd49-4be4-9f6a-8b285608ea79 req-7b66781d-7dc8-42a1-9238-37c00f5b3262 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038800 Apr 11 23:27:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 315/948] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=10 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:36 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:27:36 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5f2a587d-3467-4cdf-ae93-5b7202907e1f tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 204 len: 0 microversion: 2.1 time: 0.120062 Apr 11 23:27:36 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 315/949] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:27:36 2023] DELETE /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=18 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:36 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:37 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:27:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-91bc61d5-adc5-435b-8978-db6ce02ef8a1 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 200 len: 1552 microversion: 2.1 time: 0.266104 Apr 11 23:27:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 320/950] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:27:36 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 1552 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-unplugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] Creating event network-vif-unplugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:27:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9e21969d-7269-4d63-9f89-68268d1a6936 req-fcdbed7a-d292-4274-bfbe-18a4836ce090 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045389 Apr 11 23:27:37 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 316/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-deleted", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] Creating event network-vif-deleted:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:27:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ecf0bb77-f600-4a1f-bd42-f1e410a30a40 req-fd791146-3343-4052-ac48-4a7af89bbb4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Apr 11 23:27:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 316/952] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:39 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7744d0-487a-49be-9355-fcf1266af37f", "name": "network-vif-plugged", "status": "completed", "tag": "75723ce6-e923-483c-a830-85c602bb8454"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:27:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] Creating event network-vif-plugged:75723ce6-e923-483c-a830-85c602bb8454 for instance de7744d0-487a-49be-9355-fcf1266af37f on user Apr 11 23:27:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-e6fdd925-02ba-4de4-88ba-f1ae8ab83ca0 req-ee6867a0-f6c9-4d72-b973-867a7feea494 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Apr 11 23:27:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 321/953] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:27:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:27:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d0f69460-5213-4c36-9d73-4af6af8cdbe1 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052151 Apr 11 23:27:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 317/954] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:27:59 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32247b58-1467-4245-984b-97ce57899939"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:02 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-2e39f0b7-bd01-4e0e-8709-8f93b5eb1557 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258882 Apr 11 23:28:02 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 317/955] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:28:01 2023] POST /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-abce0596-49a3-4c79-b802-57ef392514e9 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046705 Apr 11 23:28:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 322/956] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:28:04 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:28:04 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-148c5273-a339-4df1-98f8-dce16837ec56 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 204 len: 0 microversion: 2.1 time: 0.110353 Apr 11 23:28:04 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 318/957] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:28:04 2023] DELETE /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:28:04 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-7fe4c06b-6036-4681-9146-24b7c8849d85 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 200 len: 1679 microversion: 2.1 time: 0.194954 Apr 11 23:28:04 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 318/958] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:04 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-unplugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] Creating event network-vif-unplugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:28:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d357e1b3-2236-416a-be31-c023c6f4b9e8 req-224d8e29-abe2-4641-a561-2cf70ae4d7bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028390 Apr 11 23:28:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 323/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:28:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-deleted", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] Creating event network-vif-deleted:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:28:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d3d28919-dce4-422f-8d87-4401b851c55c req-54975609-bb6d-487e-955b-426074775cfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Apr 11 23:28:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 319/960] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:28:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:06 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546a073f-3860-4aea-9da5-713d87a3762e", "name": "network-vif-plugged", "status": "completed", "tag": "76adadaa-820a-4fa5-b837-6ef514aa0b8f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] Creating event network-vif-plugged:76adadaa-820a-4fa5-b837-6ef514aa0b8f for instance 546a073f-3860-4aea-9da5-713d87a3762e on user Apr 11 23:28:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-4f053803-2c63-46e6-8e2b-cecc0dd20970 req-f7062450-e27a-4d55-bb3a-aadd56000b2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Apr 11 23:28:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 319/961] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:28:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:09 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lazy-loading 'services' on Instance uuid acbc73d0-ab9c-4516-a821-a6dac6b38035 {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:28:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-74b7af56-eb62-49b0-864b-fe8919e21f39 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/32247b58-1467-4245-984b-97ce57899939" status: 202 len: 0 microversion: 2.1 time: 0.171069 Apr 11 23:28:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 324/962] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:28:09 2023] DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments/32247b58-1467-4245-984b-97ce57899939 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e4e5b9d4-a77c-4406-9751-d5b5608aaa3b tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Apr 11 23:28:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 320/963] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:28:09 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] [instance: 70323493-f9fa-49e5-a363-b34b9b8907a1] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] HTTP exception thrown: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Request method failure captured: Apr 11 23:28:11 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 HTTP/1.1 Apr 11 23:28:11 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:28:11 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:28:11 user devstack@n-api.service[61860]: Connection: close Apr 11 23:28:11 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:28:11 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:28:11 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:28:11 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:28:11 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNepTmYSlq1FIKMYTKVRpUNKuGZgfOckyGhfOJmjVJrEdGEf4m69FWqB59dM0a-2nn7eTXWCSzvk239gPpaeC_MJkmJQzi4d_ptv2xR-lWkmTTD2elIQKzVzkTiwgCGDJEgvPgADrVpUZQh1KbbpqdmWwy7BwtMv4XPNbSQlAGIV9MDA Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Project-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8e126b69d44b27a60c421b86b79e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e8e126b69d44b27a60c421b86b79e9f"}]}] Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Tenant: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Tenant-Id: 9e8e126b69d44b27a60c421b86b79e9f Apr 11 23:28:11 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1152745105 Apr 11 23:28:11 user devstack@n-api.service[61860]: X-User: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:28:11 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:28:11 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:28:11 user devstack@n-api.service[61860]: X-User-Id: 6beb3cae81a14fa2bae48a8eedcb3868 Apr 11 23:28:11 user devstack@n-api.service[61860]: X-User-Name: tempest-TestMinimumBasicScenario-1152745105-project-member Apr 11 23:28:11 user devstack@n-api.service[61860]: method: > Apr 11 23:28:11 user devstack@n-api.service[61860]: exception: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. Apr 11 23:28:11 user devstack@n-api.service[61860]: action_args: {'id': '70323493-f9fa-49e5-a363-b34b9b8907a1'} Apr 11 23:28:11 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. Apr 11 23:28:11 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:11 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Returning 404 to user: Instance 70323493-f9fa-49e5-a363-b34b9b8907a1 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:28:11 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c2693eca-7945-410a-ae5f-7c327bcd3ed2 tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1" status: 404 len: 111 microversion: 2.1 time: 0.162046 Apr 11 23:28:11 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 320/964] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:11 2023] GET /compute/v2.1/servers/70323493-f9fa-49e5-a363-b34b9b8907a1 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:28:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f9ab6108-4865-4d71-ad4f-ebb6d250e03a tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] Calling method '.version_select at 0x7f31579d8f70>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f9ab6108-4865-4d71-ad4f-ebb6d250e03a tempest-TestMinimumBasicScenario-1152745105 tempest-TestMinimumBasicScenario-1152745105-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-838126683" status: 202 len: 0 microversion: 2.1 time: 0.024330 Apr 11 23:28:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 325/965] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 11 23:28:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-838126683 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:28:27 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f HTTP/1.1 Apr 11 23:28:27 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:28:27 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:28:27 user devstack@n-api.service[61861]: Connection: close Apr 11 23:28:27 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:28:27 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:28:27 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:28:27 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:28:27 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61861]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:28:27 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61861]: method: > Apr 11 23:28:27 user devstack@n-api.service[61861]: exception: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61861]: action_args: {'id': 'de7744d0-487a-49be-9355-fcf1266af37f'} Apr 11 23:28:27 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:28:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7492b7a1-4736-499e-a694-38a909a39e47 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 404 len: 111 microversion: 2.1 time: 0.039636 Apr 11 23:28:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 321/966] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:27 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:28:27 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f HTTP/1.1 Apr 11 23:28:27 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:28:27 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:28:27 user devstack@n-api.service[61860]: Connection: close Apr 11 23:28:27 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:28:27 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:28:27 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:28:27 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:28:27 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61860]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:28:27 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61860]: method: > Apr 11 23:28:27 user devstack@n-api.service[61860]: exception: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61860]: action_args: {'id': 'de7744d0-487a-49be-9355-fcf1266af37f'} Apr 11 23:28:27 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:28:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ff3c73b8-d3de-4a46-8e95-90f628795fbe tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 404 len: 111 microversion: 2.1 time: 0.039987 Apr 11 23:28:27 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 321/967] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:28:27 2023] DELETE /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: de7744d0-487a-49be-9355-fcf1266af37f] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:28:27 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f HTTP/1.1 Apr 11 23:28:27 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:28:27 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:28:27 user devstack@n-api.service[61859]: Connection: close Apr 11 23:28:27 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:28:27 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:28:27 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:28:27 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:28:27 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:28:27 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:28:27 user devstack@n-api.service[61859]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:28:27 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:28:27 user devstack@n-api.service[61859]: method: > Apr 11 23:28:27 user devstack@n-api.service[61859]: exception: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61859]: action_args: {'id': 'de7744d0-487a-49be-9355-fcf1266af37f'} Apr 11 23:28:27 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. Apr 11 23:28:27 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance de7744d0-487a-49be-9355-fcf1266af37f could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:28:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-aee71227-f1e3-49c5-9ce4-f2f1fe09f1ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f" status: 404 len: 111 microversion: 2.1 time: 0.032988 Apr 11 23:28:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 326/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:27 2023] GET /compute/v2.1/servers/de7744d0-487a-49be-9355-fcf1266af37f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:28:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-bacc494f-b677-4f51-9bd1-dbd0911f77e6 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 204 len: 0 microversion: 2.1 time: 0.115371 Apr 11 23:28:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:28:27 2023] DELETE /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc7eb14e7174babb8680b4020243c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fca37343b414de6b008ad79e022f858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:28:27 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4412a835-6b80-44b1-80e5-8072613788ab tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 200 len: 1543 microversion: 2.1 time: 0.173032 Apr 11 23:28:27 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 322/970] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:27 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "name": "network-vif-unplugged", "status": "completed", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] Creating event network-vif-unplugged:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:28:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-1564579c-ba31-4ea1-8949-92734a4d027e req-21aea1eb-4d89-4974-82fd-91e39362ba1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032543 Apr 11 23:28:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 327/971] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:28:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:30 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "name": "network-vif-plugged", "status": "completed", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}, {"server_uuid": "e8b26dd1-48ce-476d-99e8-60001f2d7528", "name": "network-vif-deleted", "tag": "d998a3e0-2a86-43bd-8193-a63c4013c7c7"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:28:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Creating event network-vif-plugged:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:28:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] Creating event network-vif-deleted:d998a3e0-2a86-43bd-8193-a63c4013c7c7 for instance e8b26dd1-48ce-476d-99e8-60001f2d7528 on user Apr 11 23:28:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-6353065a-ccb3-4fd6-a333-dfbedfed18ed req-5cdd820a-c6d5-4b61-b907-6bc7905b248b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032723 Apr 11 23:28:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 323/972] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:28:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 546a073f-3860-4aea-9da5-713d87a3762e] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HTTP exception thrown: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Request method failure captured: Apr 11 23:28:54 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e HTTP/1.1 Apr 11 23:28:54 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:28:54 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:28:54 user devstack@n-api.service[61860]: Connection: close Apr 11 23:28:54 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:28:54 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:28:54 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:28:54 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:28:54 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNel8YDw5kt-zpq9o8BfXzYVAkyOMAHnDdYxI6QSwDtEgCN_xUyvgVGy2uxbbzRjrWiU6O8aPkIHpu9_rAT7hib6dDYPTiVVTLHYU5rtoK_5bX3Ounh408ZugqO_NINUM4jpRmOpGl9fnqAkNwrO18UWBgCHszsJxigpTtffDM0gLxbg Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Project-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31c373270f804948a04c8125848fa181"}]}] Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Tenant-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-User: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:28:54 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:28:54 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:28:54 user devstack@n-api.service[61860]: X-User-Id: 8d63779eda794ef0b2413ac1483f88b8 Apr 11 23:28:54 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:28:54 user devstack@n-api.service[61860]: method: > Apr 11 23:28:54 user devstack@n-api.service[61860]: exception: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. Apr 11 23:28:54 user devstack@n-api.service[61860]: action_args: {'id': '546a073f-3860-4aea-9da5-713d87a3762e'} Apr 11 23:28:54 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. Apr 11 23:28:54 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:28:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Returning 404 to user: Instance 546a073f-3860-4aea-9da5-713d87a3762e could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:28:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4964f2f2-c067-46fe-b2a0-55ce528a5f65 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e" status: 404 len: 111 microversion: 2.1 time: 0.033729 Apr 11 23:28:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 323/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:28:54 2023] GET /compute/v2.1/servers/546a073f-3860-4aea-9da5-713d87a3762e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:28:54 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:54 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:54 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b7e28558-e859-46db-babd-f702f5fef92a tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '.version_select at 0x7f3157a75c60>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:54 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b7e28558-e859-46db-babd-f702f5fef92a tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207488062" status: 202 len: 0 microversion: 2.1 time: 0.027667 Apr 11 23:28:54 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 328/974] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:28:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207488062 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:28:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:28:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a3eea0de-53f2-46c2-94c5-c214176d3bf7 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058110 Apr 11 23:28:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 324/975] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:28:59 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:29:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d29a22a4-e481-47f7-b78a-faaf01cc44f7 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 204 len: 0 microversion: 2.1 time: 0.132091 Apr 11 23:29:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 324/976] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:29:00 2023] DELETE /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-f9026d3d-7e21-4e6c-9cc2-7f036abe7379 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 200 len: 1493 microversion: 2.1 time: 0.245431 Apr 11 23:29:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 329/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:00 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 1493 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:29:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] Creating event network-vif-unplugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:29:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1087c8d6-7951-45fd-bb58-3b8e113d50df req-ab5fdcc8-ada5-4e61-9461-f50d79c79c22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031739 Apr 11 23:29:00 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 325/978] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:29:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-deleted", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] Creating event network-vif-deleted:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:29:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-1eb964bd-e4d5-4436-b1b6-aea6d7f9e7b1 req-bdab1203-280c-4bf9-a4b3-0ba0e286154d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030754 Apr 11 23:29:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 325/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:02 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61204bbb-04fb-4545-ade1-5665c733c5bd", "name": "network-vif-plugged", "status": "completed", "tag": "6eb4af06-413f-41c6-892b-f2d66653509f"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:02 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] Creating event network-vif-plugged:6eb4af06-413f-41c6-892b-f2d66653509f for instance 61204bbb-04fb-4545-ade1-5665c733c5bd on user Apr 11 23:29:02 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b1a9264d-efed-49b7-83cf-196c26219f4c req-a399b401-2e99-4aaf-aca5-a7b1124143d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027677 Apr 11 23:29:02 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 330/980] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:07 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:07 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] Creating event network-changed:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:07 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-a9690c8b-b5d6-4063-a2c6-8d99b8282956 req-2fc5b9be-8aab-4a47-8251-dc6cd58e9cdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029014 Apr 11 23:29:07 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 326/981] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:29:09 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ac623b1f-2bea-429f-9e57-d19e4c3b005f tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 204 len: 0 microversion: 2.1 time: 0.109275 Apr 11 23:29:09 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 326/982] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:29:09 2023] DELETE /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:09 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ebfdb379f540188693c63f74c9ad68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af1370fd8e646d0a5066c42dff5b30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e9753ad4-a688-4195-a7e1-bc1526cfc9bc tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 200 len: 1576 microversion: 2.1 time: 0.162588 Apr 11 23:29:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 331/983] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:09 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:29:09 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-unplugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:09 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] Creating event network-vif-unplugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-6a212a78-487f-45d5-a170-54b551fa5e63 req-54fa6f8d-19de-4607-b2a5-46caffa26669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029994 Apr 11 23:29:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 327/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:10 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-deleted", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:10 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] Creating event network-vif-deleted:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-303d6231-b995-49c3-b6c7-3313f9c40bc3 req-febf1a22-965d-4516-9bfd-0e0dea36e10f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034776 Apr 11 23:29:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 327/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}, {"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}, {"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}, {"server_uuid": "acbc73d0-ab9c-4516-a821-a6dac6b38035", "name": "network-vif-plugged", "status": "completed", "tag": "36c83f85-a0e8-4818-9f4f-490d8e14b217"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] Creating event network-vif-plugged:36c83f85-a0e8-4818-9f4f-490d8e14b217 for instance acbc73d0-ab9c-4516-a821-a6dac6b38035 on user Apr 11 23:29:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-a59c6b79-f412-4620-b8bf-542253a0e677 req-90e4d105-dbd4-44fd-b15a-7f7dd76ba03e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.035169 Apr 11 23:29:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 332/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: e8b26dd1-48ce-476d-99e8-60001f2d7528] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:29:17 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 HTTP/1.1 Apr 11 23:29:17 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:29:17 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:29:17 user devstack@n-api.service[61861]: Connection: close Apr 11 23:29:17 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:29:17 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:29:17 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:29:17 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:29:17 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:17 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:29:17 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:29:17 user devstack@n-api.service[61861]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:29:17 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:17 user devstack@n-api.service[61861]: method: > Apr 11 23:29:17 user devstack@n-api.service[61861]: exception: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. Apr 11 23:29:17 user devstack@n-api.service[61861]: action_args: {'id': 'e8b26dd1-48ce-476d-99e8-60001f2d7528'} Apr 11 23:29:17 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. Apr 11 23:29:17 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance e8b26dd1-48ce-476d-99e8-60001f2d7528 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:29:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-92b260db-c557-4f54-8598-1c47f72eaa61 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528" status: 404 len: 111 microversion: 2.1 time: 0.029501 Apr 11 23:29:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 328/987] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:17 2023] GET /compute/v2.1/servers/e8b26dd1-48ce-476d-99e8-60001f2d7528 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:29:20 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 HTTP/1.1 Apr 11 23:29:20 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:29:20 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:29:20 user devstack@n-api.service[61860]: Connection: close Apr 11 23:29:20 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:29:20 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:29:20 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:29:20 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:29:20 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:20 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:29:20 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:29:20 user devstack@n-api.service[61860]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:29:20 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:20 user devstack@n-api.service[61860]: method: > Apr 11 23:29:20 user devstack@n-api.service[61860]: exception: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61860]: action_args: {'id': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'} Apr 11 23:29:20 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:29:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-767c5067-53b2-46c0-9c96-4765e2d65626 tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 404 len: 111 microversion: 2.1 time: 0.033546 Apr 11 23:29:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 328/988] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:29:20 2023] DELETE /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] [instance: eed8cea5-9e5c-4467-8993-456cb3235fd8] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] HTTP exception thrown: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Request method failure captured: Apr 11 23:29:20 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 HTTP/1.1 Apr 11 23:29:20 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:29:20 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:29:20 user devstack@n-api.service[61859]: Connection: close Apr 11 23:29:20 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:29:20 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:29:20 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:29:20 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:29:20 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNed_MHdJ7x7kOFEDM1NVklQ31icaIKzng7w4UQi-_WHVJmF8dnZ4p_5jMfctpJSgOYja4rKo-mh3tSTcuvD1cTvkpbZ9N4G5NIyaPO5qyGxjKStZNMTV1wCwJZqwGkxAEdtZBr6yO4TW5I9Eoae8p5T-rsEy4NeS5xHdq78rI5o04w0 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Project-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fca37343b414de6b008ad79e022f858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fca37343b414de6b008ad79e022f858"}]}] Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Tenant-Id: 2fca37343b414de6b008ad79e022f858 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerActionsTestJSON-813592275 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-User: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:20 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:29:20 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:29:20 user devstack@n-api.service[61859]: X-User-Id: ddc7eb14e7174babb8680b4020243c97 Apr 11 23:29:20 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerActionsTestJSON-813592275-project-member Apr 11 23:29:20 user devstack@n-api.service[61859]: method: > Apr 11 23:29:20 user devstack@n-api.service[61859]: exception: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61859]: action_args: {'id': 'eed8cea5-9e5c-4467-8993-456cb3235fd8'} Apr 11 23:29:20 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. Apr 11 23:29:20 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:29:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Returning 404 to user: Instance eed8cea5-9e5c-4467-8993-456cb3235fd8 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:29:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-3ef5a176-1fbf-4604-9ed9-a9f07cbd7d1b tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8" status: 404 len: 111 microversion: 2.1 time: 0.034406 Apr 11 23:29:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 333/989] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:20 2023] GET /compute/v2.1/servers/eed8cea5-9e5c-4467-8993-456cb3235fd8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:29:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-e6f7edad-e433-4712-b54b-b035e1109d5c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] Calling method '.version_select at 0x7f3134777880>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-e6f7edad-e433-4712-b54b-b035e1109d5c tempest-ServerActionsTestJSON-813592275 tempest-ServerActionsTestJSON-813592275-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554463927" status: 202 len: 0 microversion: 2.1 time: 0.025950 Apr 11 23:29:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 329/990] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 23:29:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554463927 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-600598354", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "d160dc36-a006-4029-9540-b148fec639df"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] validate_networks() for [('d160dc36-a006-4029-9540-b148fec639df', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for user 34d0482650674249adb77724a287d53e and project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:29:32 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:29:32 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-eb5b141a-2c0c-4ae8-807b-189c62b28871 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.654732 Apr 11 23:29:32 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 329/991] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:29:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=18 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:32 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1f1b43e7-6c66-491b-ade3-2d1e4b92763b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 200 len: 1394 microversion: 2.87 time: 0.095829 Apr 11 23:29:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 334/992] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:29:32 2023] GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 1394 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=14 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:35 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:35 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] Creating event network-changed:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:29:35 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1feae8ff-f4c6-4397-8def-44717024c466 req-6e389878-bad1-4696-a1ec-9ad6b82bfa29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085882 Apr 11 23:29:35 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 330/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:37 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "name": "network-vif-plugged", "status": "completed", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:37 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] Creating event network-vif-plugged:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:29:37 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-c6b8ab56-6976-4276-ab7c-0d4134e4cc07 req-710d6ee4-d464-4371-aa98-c2054a372bea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Apr 11 23:29:37 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 330/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:39 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "name": "network-vif-plugged", "status": "completed", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:39 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] Creating event network-vif-plugged:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:29:39 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-570e2ce6-7b28-4973-9c22-a2eb1d3bd68f req-6aaada4c-296b-43c4-858b-f9c6f2f1f320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Apr 11 23:29:39 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 335/995] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: 61204bbb-04fb-4545-ade1-5665c733c5bd] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HTTP exception thrown: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Request method failure captured: Apr 11 23:29:50 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd HTTP/1.1 Apr 11 23:29:50 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:29:50 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:29:50 user devstack@n-api.service[61861]: Connection: close Apr 11 23:29:50 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:29:50 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:29:50 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:29:50 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:29:50 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNel8YDw5kt-zpq9o8BfXzYVAkyOMAHnDdYxI6QSwDtEgCN_xUyvgVGy2uxbbzRjrWiU6O8aPkIHpu9_rAT7hib6dDYPTiVVTLHYU5rtoK_5bX3Ounh408ZugqO_NINUM4jpRmOpGl9fnqAkNwrO18UWBgCHszsJxigpTtffDM0gLxbg Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Project-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31c373270f804948a04c8125848fa181"}]}] Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Tenant-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-User: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:29:50 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:29:50 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:29:50 user devstack@n-api.service[61861]: X-User-Id: 8d63779eda794ef0b2413ac1483f88b8 Apr 11 23:29:50 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:29:50 user devstack@n-api.service[61861]: method: > Apr 11 23:29:50 user devstack@n-api.service[61861]: exception: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. Apr 11 23:29:50 user devstack@n-api.service[61861]: action_args: {'id': '61204bbb-04fb-4545-ade1-5665c733c5bd'} Apr 11 23:29:50 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. Apr 11 23:29:50 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Returning 404 to user: Instance 61204bbb-04fb-4545-ade1-5665c733c5bd could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:29:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c5e42d90-ddd1-4c79-af0a-dcf2ff6f7f0c tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd" status: 404 len: 111 microversion: 2.1 time: 0.161589 Apr 11 23:29:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 331/996] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:50 2023] GET /compute/v2.1/servers/61204bbb-04fb-4545-ade1-5665c733c5bd => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:50 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:29:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ac808b07-3ea5-4503-9bf7-3ea97b1bdbd4 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 204 len: 0 microversion: 2.1 time: 0.131532 Apr 11 23:29:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 331/997] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:29:50 2023] DELETE /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:50 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:51 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d63779eda794ef0b2413ac1483f88b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c373270f804948a04c8125848fa181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:29:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e5117d03-5cdb-4c93-8f29-aea0f60e6b99 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 200 len: 1511 microversion: 2.1 time: 0.655362 Apr 11 23:29:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 336/998] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:50 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 1511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:29:51 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-unplugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:51 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] Creating event network-vif-unplugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:29:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-24ba7ca6-29ac-4838-a40c-d6f50b90df6c req-06c2baf2-a8c1-4b82-a776-9ffdb7beea08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032904 Apr 11 23:29:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 332/999] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-deleted", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] Creating event network-vif-deleted:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:29:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-bc82332c-c147-4213-9f7d-124928e01995 req-264c2363-b6f8-4707-ab49-85e2eaf1e654 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055221 Apr 11 23:29:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 332/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8aa618-99bb-49d7-b547-e5db4470f4c6", "name": "network-vif-plugged", "status": "completed", "tag": "af81e577-93ac-47a7-8666-377d53fad5c2"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:29:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] Creating event network-vif-plugged:af81e577-93ac-47a7-8666-377d53fad5c2 for instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 on user Apr 11 23:29:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-899bab34-dd03-45ae-b1f4-71e4675daceb req-8a1c6346-6642-4ddb-a0f2-a1e748e1cd13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Apr 11 23:29:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 337/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] [instance: acbc73d0-ab9c-4516-a821-a6dac6b38035] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:29:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] HTTP exception thrown: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Request method failure captured: Apr 11 23:29:59 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 HTTP/1.1 Apr 11 23:29:59 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:29:59 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:29:59 user devstack@n-api.service[61861]: Connection: close Apr 11 23:29:59 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:29:59 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:29:59 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:29:59 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:29:59 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNevNVFCeO_JFv0J523CPDGWZP2qHKCYUKbIYKNbqx9Ab_XDnsVcdpPCpSfjLi2iXlW9z8hK7g9fNa9PW1UVBi8gE54l2aS5w2iJA4qIK3C-ChP3iFp9Xr66A8iHcLIhHHIV2X7s0jLiKCYKmOhcNt-gVvGbuRjpPTmwpXhnHP8MsUTo Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Project-Id: 2af1370fd8e646d0a5066c42dff5b30f Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1086939592 Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2af1370fd8e646d0a5066c42dff5b30f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2af1370fd8e646d0a5066c42dff5b30f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2af1370fd8e646d0a5066c42dff5b30f"}]}] Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Tenant: tempest-SnapshotDataIntegrityTests-1086939592 Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Tenant-Id: 2af1370fd8e646d0a5066c42dff5b30f Apr 11 23:29:59 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1086939592 Apr 11 23:29:59 user devstack@n-api.service[61861]: X-User: tempest-SnapshotDataIntegrityTests-1086939592-project-member Apr 11 23:29:59 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:29:59 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:29:59 user devstack@n-api.service[61861]: X-User-Id: e0ebfdb379f540188693c63f74c9ad68 Apr 11 23:29:59 user devstack@n-api.service[61861]: X-User-Name: tempest-SnapshotDataIntegrityTests-1086939592-project-member Apr 11 23:29:59 user devstack@n-api.service[61861]: method: > Apr 11 23:29:59 user devstack@n-api.service[61861]: exception: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. Apr 11 23:29:59 user devstack@n-api.service[61861]: action_args: {'id': 'acbc73d0-ab9c-4516-a821-a6dac6b38035'} Apr 11 23:29:59 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. Apr 11 23:29:59 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:29:59 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Returning 404 to user: Instance acbc73d0-ab9c-4516-a821-a6dac6b38035 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:29:59 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-b3d9e5c3-beed-4e3b-ab94-29fa27580c62 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035" status: 404 len: 111 microversion: 2.1 time: 0.030519 Apr 11 23:29:59 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 333/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:29:59 2023] GET /compute/v2.1/servers/acbc73d0-ab9c-4516-a821-a6dac6b38035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:29:59 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-0c61da42-04fc-46f6-9c3e-c5a93dd27132 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] Calling method '.version_select at 0x7f3157a37250>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:29:59 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-0c61da42-04fc-46f6-9c3e-c5a93dd27132 tempest-SnapshotDataIntegrityTests-1086939592 tempest-SnapshotDataIntegrityTests-1086939592-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1460777543" status: 202 len: 0 microversion: 2.1 time: 0.022931 Apr 11 23:29:59 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 333/1003] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 11 23:29:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1460777543 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:30:22 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:30:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:30:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:30:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:30:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-8483d6b2-3c19-4d6a-9727-3a8715c9a806 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 200 len: 1689 microversion: 2.87 time: 0.301293 Apr 11 23:30:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 338/1004] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:30:22 2023] GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 1689 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] [instance: dd8aa618-99bb-49d7-b547-e5db4470f4c6] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:30:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] HTTP exception thrown: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Request method failure captured: Apr 11 23:30:41 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 HTTP/1.1 Apr 11 23:30:41 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:30:41 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:30:41 user devstack@n-api.service[61861]: Connection: close Apr 11 23:30:41 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:30:41 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:30:41 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:30:41 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:30:41 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNel8YDw5kt-zpq9o8BfXzYVAkyOMAHnDdYxI6QSwDtEgCN_xUyvgVGy2uxbbzRjrWiU6O8aPkIHpu9_rAT7hib6dDYPTiVVTLHYU5rtoK_5bX3Ounh408ZugqO_NINUM4jpRmOpGl9fnqAkNwrO18UWBgCHszsJxigpTtffDM0gLxbg Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Project-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31c373270f804948a04c8125848fa181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31c373270f804948a04c8125848fa181"}]}] Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Tenant-Id: 31c373270f804948a04c8125848fa181 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-242021724 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-User: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:30:41 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:30:41 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:30:41 user devstack@n-api.service[61861]: X-User-Id: 8d63779eda794ef0b2413ac1483f88b8 Apr 11 23:30:41 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-242021724-project-member Apr 11 23:30:41 user devstack@n-api.service[61861]: method: > Apr 11 23:30:41 user devstack@n-api.service[61861]: exception: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. Apr 11 23:30:41 user devstack@n-api.service[61861]: action_args: {'id': 'dd8aa618-99bb-49d7-b547-e5db4470f4c6'} Apr 11 23:30:41 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. Apr 11 23:30:41 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:41 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] Returning 404 to user: Instance dd8aa618-99bb-49d7-b547-e5db4470f4c6 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:30:41 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9b8d2f1e-8380-40c9-9447-d6af5af51ae2 tempest-ServerRescueNegativeTestJSON-242021724 tempest-ServerRescueNegativeTestJSON-242021724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6" status: 404 len: 111 microversion: 2.1 time: 0.034784 Apr 11 23:30:41 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 334/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:30:41 2023] GET /compute/v2.1/servers/dd8aa618-99bb-49d7-b547-e5db4470f4c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:30:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-94462bb2-1787-4b7f-be41-6586c48827d7 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Action: 'create', calling method: .version_select at 0x7f3157a37010>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1123870550"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:30:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-94462bb2-1787-4b7f-be41-6586c48827d7 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.633057 Apr 11 23:30:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 334/1006] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 23:30:45 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 634 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 23:30:46 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-457bcbbc-8b4e-4fc3-ae37-c607203b44a6 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3157a77f40>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:46 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:46 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:46 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-457bcbbc-8b4e-4fc3-ae37-c607203b44a6 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 200 len: 345 microversion: 2.1 time: 0.056997 Apr 11 23:30:46 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 339/1007] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:46 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:30:47 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c4c1328b-c425-41dc-9a16-f8f3fc09d121 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3134776d40>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:47 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c4c1328b-c425-41dc-9a16-f8f3fc09d121 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 200 len: 346 microversion: 2.1 time: 0.098040 Apr 11 23:30:47 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 335/1008] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:47 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:47 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-88a52094-69c5-4416-a0fa-3e9eb5c508cf tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Action: 'create', calling method: .version_select at 0x7f315799ab00>, body: {"snapshot": {"volume_id": "221e50b6-1547-4cbf-91fd-18485262d392", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-966675451"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:30:47 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-88a52094-69c5-4416-a0fa-3e9eb5c508cf tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163358 Apr 11 23:30:47 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 335/1009] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 23:30:47 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1cecbc3c-f738-4176-b046-e55d466fffce tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f31579dae60>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1cecbc3c-f738-4176-b046-e55d466fffce tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 200 len: 286 microversion: 2.1 time: 0.041250 Apr 11 23:30:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 340/1010] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 23:30:47 2023] GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:48 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-be6c021f-00d7-46d4-a3cc-ee8c8ba23421 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3134775f30>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:48 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-be6c021f-00d7-46d4-a3cc-ee8c8ba23421 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039220 Apr 11 23:30:48 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 336/1011] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 23:30:48 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:48 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-ed0561aa-e628-40ef-8ce6-9801acb6b13a tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f31586d28c0>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:48 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-ed0561aa-e628-40ef-8ce6-9801acb6b13a tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 200 len: 286 microversion: 2.1 time: 0.033290 Apr 11 23:30:48 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 23:30:48 2023] GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:49 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-82a4f53d-a7aa-4a20-a0d3-e9422bca283c tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3157cee710>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:49 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-82a4f53d-a7aa-4a20-a0d3-e9422bca283c tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 200 len: 287 microversion: 2.1 time: 0.040664 Apr 11 23:30:49 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 341/1013] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 23:30:49 2023] GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:49 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d055b5e9-5278-49a8-b763-7577a3380627 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f31347745e0>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:49 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d055b5e9-5278-49a8-b763-7577a3380627 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 202 len: 0 microversion: 2.1 time: 0.065802 Apr 11 23:30:49 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 337/1014] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 23:30:49 2023] DELETE /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:30:49 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fbfb1d6f-0cb9-46e8-88ae-1c78e0c93034 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3157999510>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:49 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fbfb1d6f-0cb9-46e8-88ae-1c78e0c93034 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 200 len: 286 microversion: 2.1 time: 0.034122 Apr 11 23:30:49 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 23:30:49 2023] GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5577e957-edbe-4729-bf66-5f0f8817ec10 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f31579d8940>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-5577e957-edbe-4729-bf66-5f0f8817ec10 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] HTTP exception thrown: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. Apr 11 23:30:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5577e957-edbe-4729-bf66-5f0f8817ec10 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Request method failure captured: Apr 11 23:30:50 user devstack@n-api.service[61859]: request: GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d HTTP/1.1 Apr 11 23:30:50 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:30:50 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:30:50 user devstack@n-api.service[61859]: Connection: close Apr 11 23:30:50 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:30:50 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:30:50 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:30:50 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:30:50 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNe2lGMI8wCkp5RpKPfR8fFpLd5Qui02K3CQVEf4oT5rHha55vOoObS0e8VY0jIKX67a6Enu4k7Iv9bqb2A4vbGez-KPPVFn7BA_WPA90385L2nXO_8MpjVgjvYh-A9b1R3376TgpyaprMPqCM3rVb2YuqlCv0F95o8FS1TCOPOCYR_w Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Project-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77a48dbe66e54196845e3448fdd3c0aa"}]}] Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Tenant-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:50 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:50 user devstack@n-api.service[61859]: X-User: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:50 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:30:50 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:30:50 user devstack@n-api.service[61859]: X-User-Id: b76b00b73612430ab6dcebf22ea6ed25 Apr 11 23:30:50 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:50 user devstack@n-api.service[61859]: method: Apr 11 23:30:50 user devstack@n-api.service[61859]: exception: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. Apr 11 23:30:50 user devstack@n-api.service[61859]: action_args: {'id': '078bc01c-aaec-4f3d-b0e8-579505b1805d'} Apr 11 23:30:50 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. (HTTP 404) (Request-ID: req-2e100626-61fb-401f-b855-2cdd98916be0) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. Apr 11 23:30:50 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:50 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5577e957-edbe-4729-bf66-5f0f8817ec10 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Returning 404 to user: Snapshot 078bc01c-aaec-4f3d-b0e8-579505b1805d could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:30:50 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5577e957-edbe-4729-bf66-5f0f8817ec10 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d" status: 404 len: 111 microversion: 2.1 time: 0.033574 Apr 11 23:30:50 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 342/1016] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 23:30:50 2023] GET /compute/v2.1/os-snapshots/078bc01c-aaec-4f3d-b0e8-579505b1805d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:30:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-218a149e-ff0e-428c-ae9d-c99af1f54111 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3134775000>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:50 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-218a149e-ff0e-428c-ae9d-c99af1f54111 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 202 len: 0 microversion: 2.1 time: 0.063075 Apr 11 23:30:50 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 338/1017] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:30:50 2023] DELETE /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:30:50 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-03885bcf-b7a1-456c-9491-857330d1caa9 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f31578a9990>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:50 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-03885bcf-b7a1-456c-9491-857330d1caa9 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 200 len: 345 microversion: 2.1 time: 0.053301 Apr 11 23:30:50 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:50 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:30:51 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e0ee9158-771a-4bb6-819f-a2c3b323bc89 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3157cedc60>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e0ee9158-771a-4bb6-819f-a2c3b323bc89 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 200 len: 345 microversion: 2.1 time: 0.052295 Apr 11 23:30:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 343/1019] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:51 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:30:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:30:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6a0b4d2d-9906-49c1-853c-558c3aa05f62 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3134777400>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-6a0b4d2d-9906-49c1-853c-558c3aa05f62 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] HTTP exception thrown: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6a0b4d2d-9906-49c1-853c-558c3aa05f62 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Request method failure captured: Apr 11 23:30:52 user devstack@n-api.service[61861]: request: GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 HTTP/1.1 Apr 11 23:30:52 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:30:52 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:30:52 user devstack@n-api.service[61861]: Connection: close Apr 11 23:30:52 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:30:52 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:30:52 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:30:52 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:30:52 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNe2lGMI8wCkp5RpKPfR8fFpLd5Qui02K3CQVEf4oT5rHha55vOoObS0e8VY0jIKX67a6Enu4k7Iv9bqb2A4vbGez-KPPVFn7BA_WPA90385L2nXO_8MpjVgjvYh-A9b1R3376TgpyaprMPqCM3rVb2YuqlCv0F95o8FS1TCOPOCYR_w Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Project-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77a48dbe66e54196845e3448fdd3c0aa"}]}] Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Tenant-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61861]: X-User: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61861]: X-User-Id: b76b00b73612430ab6dcebf22ea6ed25 Apr 11 23:30:52 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61861]: method: Apr 11 23:30:52 user devstack@n-api.service[61861]: exception: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61861]: action_args: {'id': '221e50b6-1547-4cbf-91fd-18485262d392'} Apr 11 23:30:52 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. (HTTP 404) (Request-ID: req-90a63b42-cbb4-4399-b4d7-adce28740681) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6a0b4d2d-9906-49c1-853c-558c3aa05f62 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Returning 404 to user: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:30:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6a0b4d2d-9906-49c1-853c-558c3aa05f62 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 404 len: 109 microversion: 2.1 time: 0.038314 Apr 11 23:30:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 339/1020] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:52 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:30:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c153f295-5f55-4d19-aacc-3508143769f2 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f3157729000>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-c153f295-5f55-4d19-aacc-3508143769f2 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] HTTP exception thrown: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c153f295-5f55-4d19-aacc-3508143769f2 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Request method failure captured: Apr 11 23:30:52 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 HTTP/1.1 Apr 11 23:30:52 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:30:52 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:30:52 user devstack@n-api.service[61860]: Connection: close Apr 11 23:30:52 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:30:52 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:30:52 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:30:52 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:30:52 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNe2lGMI8wCkp5RpKPfR8fFpLd5Qui02K3CQVEf4oT5rHha55vOoObS0e8VY0jIKX67a6Enu4k7Iv9bqb2A4vbGez-KPPVFn7BA_WPA90385L2nXO_8MpjVgjvYh-A9b1R3376TgpyaprMPqCM3rVb2YuqlCv0F95o8FS1TCOPOCYR_w Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Project-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77a48dbe66e54196845e3448fdd3c0aa"}]}] Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Tenant-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61860]: X-User: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61860]: X-User-Id: b76b00b73612430ab6dcebf22ea6ed25 Apr 11 23:30:52 user devstack@n-api.service[61860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61860]: method: Apr 11 23:30:52 user devstack@n-api.service[61860]: exception: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61860]: action_args: {'id': '221e50b6-1547-4cbf-91fd-18485262d392'} Apr 11 23:30:52 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. (HTTP 404) (Request-ID: req-1a7c19a6-7fb1-4589-86d6-14d2be5b1bc7) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-c153f295-5f55-4d19-aacc-3508143769f2 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Returning 404 to user: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:30:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-c153f295-5f55-4d19-aacc-3508143769f2 tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 404 len: 109 microversion: 2.1 time: 0.036322 Apr 11 23:30:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 23:30:52 2023] DELETE /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:30:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7461fa46-ae9a-4a55-8400-a57a66582a2d tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Calling method '.version_select at 0x7f315774d750>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:30:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-7461fa46-ae9a-4a55-8400-a57a66582a2d tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] HTTP exception thrown: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7461fa46-ae9a-4a55-8400-a57a66582a2d tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Request method failure captured: Apr 11 23:30:52 user devstack@n-api.service[61859]: request: GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 HTTP/1.1 Apr 11 23:30:52 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:30:52 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:30:52 user devstack@n-api.service[61859]: Connection: close Apr 11 23:30:52 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:30:52 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:30:52 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:30:52 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:30:52 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNe2lGMI8wCkp5RpKPfR8fFpLd5Qui02K3CQVEf4oT5rHha55vOoObS0e8VY0jIKX67a6Enu4k7Iv9bqb2A4vbGez-KPPVFn7BA_WPA90385L2nXO_8MpjVgjvYh-A9b1R3376TgpyaprMPqCM3rVb2YuqlCv0F95o8FS1TCOPOCYR_w Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Project-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77a48dbe66e54196845e3448fdd3c0aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77a48dbe66e54196845e3448fdd3c0aa"}]}] Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Tenant-Id: 77a48dbe66e54196845e3448fdd3c0aa Apr 11 23:30:52 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-133764852 Apr 11 23:30:52 user devstack@n-api.service[61859]: X-User: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:30:52 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:30:52 user devstack@n-api.service[61859]: X-User-Id: b76b00b73612430ab6dcebf22ea6ed25 Apr 11 23:30:52 user devstack@n-api.service[61859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-133764852-project-member Apr 11 23:30:52 user devstack@n-api.service[61859]: method: Apr 11 23:30:52 user devstack@n-api.service[61859]: exception: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61859]: action_args: {'id': '221e50b6-1547-4cbf-91fd-18485262d392'} Apr 11 23:30:52 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. (HTTP 404) (Request-ID: req-f54cd5f5-3cb6-4a48-920d-147abfd40747) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. Apr 11 23:30:52 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:30:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7461fa46-ae9a-4a55-8400-a57a66582a2d tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] Returning 404 to user: Volume 221e50b6-1547-4cbf-91fd-18485262d392 could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:30:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7461fa46-ae9a-4a55-8400-a57a66582a2d tempest-VolumesSnapshotsTestJSON-133764852 tempest-VolumesSnapshotsTestJSON-133764852-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392" status: 404 len: 109 microversion: 2.1 time: 0.036372 Apr 11 23:30:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 344/1022] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:30:52 2023] GET /compute/v2.1/os-volumes/221e50b6-1547-4cbf-91fd-18485262d392 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1186929216"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-7c4e1516-0081-4edd-8e30-c744872d1c1b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b/action" status: 202 len: 52 microversion: 2.87 time: 1.256127 Apr 11 23:31:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 340/1023] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:31:23 2023] POST /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b/action => generated 52 bytes in 1258 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 23:31:29 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-15b5e4e5-3fa1-47be-a403-36f9c3a696c5 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'create', calling method: .version_select at 0x7f3157999510>, body: {"keypair": {"name": "tempest-TestStampPattern-718348001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDPm4ZPOCf1l7GfxihjBWYCbrccfGFsoS4jnE01iprxBmAib6g39KNKImt4ZLVsCOh1eFL88paYMZusOg3ArGPCcKgWAPxJaKEnhN2keDRL16gSTkvFeR2q1Q375pTqdw=="}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:29 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-15b5e4e5-3fa1-47be-a403-36f9c3a696c5 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for project 6bef1ddbef124fff82634357a1db9594. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:31:29 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-15b5e4e5-3fa1-47be-a403-36f9c3a696c5 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for user 3fba33ae43c34bbba115df1e892b2034 and project 6bef1ddbef124fff82634357a1db9594. Resources: {'key_pairs'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:31:29 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-15b5e4e5-3fa1-47be-a403-36f9c3a696c5 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.157428 Apr 11 23:31:29 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 340/1024] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 23:31:29 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:29 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:31:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:31:30 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:31:30 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-1ee7571a-0dc6-4d8b-ba93-10d98c82b468 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 200 len: 1689 microversion: 2.87 time: 0.202748 Apr 11 23:31:30 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 345/1025] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:31:29 2023] GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1183745125", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "key_name": "tempest-TestStampPattern-718348001", "security_groups": [{"name": "tempest-secgroup-smoke-1684404149"}], "networks": [{"uuid": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb"}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] validate_networks() for [('7d70a371-58db-4a54-b567-b4ef7d0e9cdb', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:32 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:33 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for project 6bef1ddbef124fff82634357a1db9594. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:31:33 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for user 3fba33ae43c34bbba115df1e892b2034 and project 6bef1ddbef124fff82634357a1db9594. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:31:33 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:31:33 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:31:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-77e6b701-98cd-4e8f-a85d-c402615f6065 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.684611 Apr 11 23:31:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 341/1026] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:31:32 2023] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:31:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6a665d4b-4fdd-45a9-a71f-68920c06d9aa tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:31:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6a665d4b-4fdd-45a9-a71f-68920c06d9aa tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:31:33 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-6a665d4b-4fdd-45a9-a71f-68920c06d9aa tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:31:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6a665d4b-4fdd-45a9-a71f-68920c06d9aa tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 200 len: 1236 microversion: 2.1 time: 0.105842 Apr 11 23:31:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:31:33 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:31:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] Creating event network-changed:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:31:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-369babd9-bfa3-4dad-9fce-e4b415af9eaa req-3d9b39f3-cb51-4f51-b1ff-59d60009fcf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Apr 11 23:31:35 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 346/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:31:37 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "name": "network-vif-plugged", "status": "completed", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:37 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] Creating event network-vif-plugged:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:31:37 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-eff97d8a-ddf1-4be1-80ac-747e9b0a3c4d req-ed033cd1-37bd-4694-ac16-fe33799a92a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165690 Apr 11 23:31:37 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 342/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:31:39 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "name": "network-vif-plugged", "status": "completed", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:31:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:31:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:31:39 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:31:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] Creating event network-vif-plugged:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:31:39 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2772e561-03aa-466a-99f1-96c7319d91c2 req-998d60b6-fe09-499b-88ec-a4493392262e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Apr 11 23:31:39 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 342/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:23 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:32:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-34fa039c-71fe-406e-a84c-08c312f833f3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 200 len: 1538 microversion: 2.1 time: 0.185465 Apr 11 23:32:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 347/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:32:23 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 1538 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:32:30 user devstack@n-api.service[61861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-965527401", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "d160dc36-a006-4029-9540-b148fec639df"}]}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.network.neutron [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] validate_networks() for [('d160dc36-a006-4029-9540-b148fec639df', None, None, None, None, None)] {{(pid=61861) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.virt.hardware [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.quota [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for user 34d0482650674249adb77724a287d53e and project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Going to run 1 instances... {{(pid=61861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:32:30 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:32:30 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-5b14138e-06c8-4916-9182-317ce435c816 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.527463 Apr 11 23:32:30 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 343/1032] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:32:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:32:30 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:32:30 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-aca5d5f0-e5b3-435a-80b2-7a57cf6c3122 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1394 microversion: 2.87 time: 0.089829 Apr 11 23:32:30 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 343/1033] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:32:30 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1394 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:32:32 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:32:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:32 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] Creating event network-changed:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:32:32 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c39cfe48-72d5-473c-8339-7c49562777fe req-3a5ca81c-c2f7-429a-8803-fd826e821a3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084512 Apr 11 23:32:32 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 348/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:44 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:44 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50122. Apr 11 23:32:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:32:44 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-96d0817a-c6bc-4f37-8d32-9cd8aa91d65f req-9ce0e645-974f-4360-a6dc-98c07d3ce9b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050384 Apr 11 23:32:44 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 344/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:32:46 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:32:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:32:46 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-857cdc65-6996-4e5d-9c41-45bf048ceb5c req-ad82bb15-8890-40e6-8b7b-17cf93523cbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Apr 11 23:32:46 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 344/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:32:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:20 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:21 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:33:21 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:33:21 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:33:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-5499b308-e263-4dbe-bf5f-24e8542e34f4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1767 microversion: 2.87 time: 0.166644 Apr 11 23:33:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 349/1037] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:33:20 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1767 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:23 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:33:23 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-9605c88f-1924-4d58-80f1-1de9070eb116 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 200 len: 1538 microversion: 2.1 time: 0.204925 Apr 11 23:33:23 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 345/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:33:23 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 1538 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] Creating event network-changed:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:33:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-3c497fc3-bcc8-4494-ae0e-32e81934afc6 req-08050eba-ce5e-467b-836c-048376ecebd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Apr 11 23:33:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 345/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:33:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-7c1b6942-898e-46b6-bfe3-cdacf24ad351 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299096 Apr 11 23:33:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 350/1040] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:33:25 2023] POST /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:33 user devstack@n-api.service[61861]: DEBUG nova.objects.instance [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'services' on Instance uuid 6daabd9b-ed06-4bfc-a323-e464f5e29b3c {{(pid=61861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:33:33 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d4010ac8-9b20-4c08-9896-6a4508260e3b tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments/a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4" status: 202 len: 0 microversion: 2.1 time: 0.212623 Apr 11 23:33:33 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 346/1041] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:33:33 2023] DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments/a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:33:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:33:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-bb783f7d-ee57-4c0a-85ec-fb8fdda69cc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Apr 11 23:33:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:33:33 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "423d8b6d-f031-4f06-9bff-cc34e289190e"}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:21 user devstack@n-api.service[61859]: DEBUG nova.objects.instance [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'flavor' on Instance uuid 16682788-70d1-400d-adc3-0518282c04fa {{(pid=61859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:34:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-020396fc-03c7-4297-a9dd-5b4dad02685a tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa/action" status: 200 len: 29 microversion: 2.87 time: 0.510010 Apr 11 23:34:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 351/1043] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:34:21 2023] POST /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa/action => generated 29 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:34:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:34:22 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:34:22 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-03336a66-7660-4808-9fdf-9486627a90dc tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1773 microversion: 2.87 time: 0.326349 Apr 11 23:34:22 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 347/1044] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:34:21 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1773 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-unplugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:22 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:34:22 user devstack@n-api.service[61860]: Tue Apr 11 23:34:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:34:22 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:34:22 user devstack@n-api.service[61860]: Tue Apr 11 23:34:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] Creating event network-vif-unplugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:34:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9f9f781f-7bf0-447f-a216-a13aa2350c8b req-e3df55e7-848b-47b1-8128-c42e5e2ae48a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041222 Apr 11 23:34:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 347/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2c64a12e-eed9-458c-8a82-88709b930845 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080497 Apr 11 23:34:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 352/1046] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:34:23 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:34:24 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:24 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:34:24 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e14fabb0-71d1-49dd-9002-3bde681e7929 req-2832fbd5-a6d0-481d-9f1a-bea9d38100a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Apr 11 23:34:24 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 348/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-141295392"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-63c83a9e-c779-43ff-9554-b5a73fb5b026 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/action" status: 202 len: 0 microversion: 2.1 time: 0.857086 Apr 11 23:34:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 348/1048] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 23:34:25 2023] POST /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 23:34:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:34:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-606d1f90-cf01-4bd1-8fd4-388b217eca01 req-78bc32a6-2a82-419e-bac5-7c80c017af71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 Apr 11 23:34:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 353/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:29 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:29 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:29 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:34:29 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-e36fbab8-815f-42db-b58c-148d59170ab8 req-3cc2a62b-e3f9-4f92-a577-ade45891f499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Apr 11 23:34:29 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 349/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:32 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1459997543", "imageRef": "74c41659-7d9e-414c-bd94-94665c6dd7f1", "flavorRef": "42", "key_name": "tempest-TestStampPattern-718348001", "security_groups": [{"name": "tempest-secgroup-smoke-1684404149"}], "networks": [{"uuid": "7d70a371-58db-4a54-b567-b4ef7d0e9cdb"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:32 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] validate_networks() for [('7d70a371-58db-4a54-b567-b4ef7d0e9cdb', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for project 6bef1ddbef124fff82634357a1db9594. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Getting quotas for user 3fba33ae43c34bbba115df1e892b2034 and project 6bef1ddbef124fff82634357a1db9594. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:34:33 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74c41659-7d9e-414c-bd94-94665c6dd7f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:34:33 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fc2dfc30-184e-4c3f-a8be-f9f4006b7c76 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.731256 Apr 11 23:34:33 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 349/1051] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:34:32 2023] POST /compute/v2.1/servers => generated 404 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:34:33 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b2f2b53c-33e1-432d-b4c0-4ab69eec8d81 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:34:33 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b2f2b53c-33e1-432d-b4c0-4ab69eec8d81 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:34:33 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b2f2b53c-33e1-432d-b4c0-4ab69eec8d81 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:34:33 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b2f2b53c-33e1-432d-b4c0-4ab69eec8d81 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 200 len: 1236 microversion: 2.1 time: 0.078004 Apr 11 23:34:33 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 354/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:34:33 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:34:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] Creating event network-changed:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:34:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-f0097eee-b590-4dfc-a3dc-fa0cfe4600fe req-2fc96242-86d1-4cd1-b912-f4d22345f84f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029398 Apr 11 23:34:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:38 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "name": "network-vif-plugged", "status": "completed", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:38 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] Creating event network-vif-plugged:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:34:38 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-c717f576-5725-41ee-bab5-4a81cc77e989 req-1bc30b64-ccc7-417e-82dc-78e276df84dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045211 Apr 11 23:34:38 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 350/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:34:41 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "name": "network-vif-plugged", "status": "completed", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:34:41 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:34:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:34:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:34:41 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:34:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] Creating event network-vif-plugged:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:34:41 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-25f129ac-7fbd-4324-9f88-a1dd2e54f4ae req-d71cb47d-d3c0-4f9f-a25c-5ec59642a232 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044406 Apr 11 23:34:41 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 355/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:35:12 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:35:12 user devstack@n-api.service[61861]: Tue Apr 11 23:35:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa (ip 10.0.0.210) !!! Apr 11 23:35:12 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:35:12 user devstack@n-api.service[61861]: Tue Apr 11 23:35:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa (ip 10.0.0.210) !!! Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=10 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=12 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:35:12 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:35:12 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-11c59c4b-a9f4-4ddb-897a-06f5ded8353f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1753 microversion: 2.87 time: 0.253301 Apr 11 23:35:12 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 351/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:35:12 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:35:23 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:35:23 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-fca04921-c60d-4bbd-b68b-e32f92b4d4a3 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 200 len: 1538 microversion: 2.1 time: 0.227101 Apr 11 23:35:23 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 351/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:35:23 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 1538 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=12 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:12 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:36:12 user devstack@n-api.service[61859]: Tue Apr 11 23:36:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa/action (ip 10.0.0.210) !!! Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:12 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:12 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9c474799-183c-4fdc-ae8a-bac747069b63 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa/action" status: 202 len: 0 microversion: 2.87 time: 0.087488 Apr 11 23:36:12 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 356/1058] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:36:12 2023] POST /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:12 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:13 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:36:13 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:36:13 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:36:13 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-31737b8d-5dd3-43ba-9352-03d9e758ea40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1761 microversion: 2.87 time: 0.352646 Apr 11 23:36:13 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 352/1059] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:36:12 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1761 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-unplugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:13 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] Creating event network-vif-unplugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:36:13 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-26783d5c-c5d4-4bd8-9b6e-f260e4a9fc36 req-0ad7f514-c2b1-40da-8fbf-29eac55e88c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044770 Apr 11 23:36:13 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 352/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:36:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:36:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}, {"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:36:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:36:15 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-75f8d14a-19c8-491f-9cef-b82bb1a6f5f8 req-05aa68a2-4cac-4471-a347-50280b3fa571 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035029 Apr 11 23:36:15 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 357/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:36:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:36:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:36:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-32ba03c1-8cf4-4ba6-9a65-63609da11589 req-76071aaa-79cf-48b3-bb6b-013813c5dc06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Apr 11 23:36:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 353/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:36:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 23:36:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:23 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:24 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:36:24 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a87fe439-32f5-4d89-af96-f9d23b77281f tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 200 len: 1538 microversion: 2.1 time: 0.302816 Apr 11 23:36:24 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 353/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:36:23 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 1538 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] Creating event network-changed:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:36:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-e8aebc22-5d89-4101-8fff-c7bd9308f9a1 req-8d4317a5-d069-4bb5-863e-5b2494766d6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037249 Apr 11 23:36:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 358/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a13e25c-a993-444b-8377-fcb263183bb5"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:27 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:27 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-8e63a502-f150-403d-8f10-f75d70ec1978 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310361 Apr 11 23:36:27 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 354/1065] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 23:36:27 2023] POST /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:35 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lazy-loading 'services' on Instance uuid ae9134ec-5953-49ad-b32f-a00a6310e497 {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:36:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-b953ee0d-ae57-4eb7-83cd-dfb853c42e36 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments/0a13e25c-a993-444b-8377-fcb263183bb5" status: 202 len: 0 microversion: 2.1 time: 0.172022 Apr 11 23:36:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 354/1066] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:36:35 2023] DELETE /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments/0a13e25c-a993-444b-8377-fcb263183bb5 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:36:35 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:36:35 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-38db4b8f-5aa2-4edc-8d89-290cb8610459 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052441 Apr 11 23:36:35 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 359/1067] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:36:35 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:37:03 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:37:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-0b110d1a-1524-41d5-a2f7-1e12c218f388 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1767 microversion: 2.87 time: 0.169365 Apr 11 23:37:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 355/1068] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:37:03 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1767 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5af14925-a382-41fa-9002-8a22a655c269 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059239 Apr 11 23:37:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 355/1069] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 23:37:25 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:37:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b5871c7f-c8ef-4729-a1e7-f86862d11509 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 204 len: 0 microversion: 2.1 time: 0.116729 Apr 11 23:37:26 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 360/1070] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:37:26 2023] DELETE /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] Creating event network-changed:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:37:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-a8eed3de-a2cb-4b49-83b3-8db9359e682a req-c0c441bc-d973-4608-b7c3-fbf542d3c25e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162407 Apr 11 23:37:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 356/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:37:26 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:37:26 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-718fedd7-132a-483b-ac1f-fe750d8115ce tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 200 len: 1662 microversion: 2.1 time: 0.198586 Apr 11 23:37:26 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 356/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:37:26 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 1662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "name": "network-vif-unplugged", "status": "completed", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:26 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] Creating event network-vif-unplugged:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:37:26 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-60a55abd-24c4-4a54-bba1-532aa9a5996f req-640d9e4c-fbad-4539-b334-abda10b1bf84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030163 Apr 11 23:37:26 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 361/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:37:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:37:28 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "name": "network-vif-plugged", "status": "completed", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}, {"server_uuid": "ae9134ec-5953-49ad-b32f-a00a6310e497", "name": "network-vif-deleted", "tag": "619a3191-9b7d-437b-bfd8-e03d80e4eddf"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:37:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:37:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:37:28 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:37:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Creating event network-vif-plugged:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:37:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] Creating event network-vif-deleted:619a3191-9b7d-437b-bfd8-e03d80e4eddf for instance ae9134ec-5953-49ad-b32f-a00a6310e497 on user Apr 11 23:37:28 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-4ab24e75-b00a-4b51-963d-c24b3743b77e req-50636573-fe55-4635-854c-29c06b437194 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032105 Apr 11 23:37:28 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 357/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-165978506", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "d160dc36-a006-4029-9540-b148fec639df"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=12 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] validate_networks() for [('d160dc36-a006-4029-9540-b148fec639df', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for user 34d0482650674249adb77724a287d53e and project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:38:03 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:38:03 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-1e0209b7-df95-48ca-9c86-036d9afea0b3 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.535762 Apr 11 23:38:03 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 357/1075] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:38:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:38:03 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:03 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:03 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:03 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:04 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-2c856342-ecd1-4a02-b493-f292c883d067 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 200 len: 1394 microversion: 2.87 time: 0.161831 Apr 11 23:38:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 362/1076] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:38:03 2023] GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 1394 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] Creating event network-changed:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:38:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-c80979d0-c939-4b64-9751-d18c51a6fc46 req-36338772-cddb-4a5a-a629-5c37d25200fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077567 Apr 11 23:38:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 358/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "name": "network-vif-plugged", "status": "completed", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] Creating event network-vif-plugged:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:38:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-7a039dd6-7817-44b1-ac32-e86f42899ac9 req-17c7ce07-1091-481a-b11b-88abc67b24ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Apr 11 23:38:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 358/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "name": "network-vif-plugged", "status": "completed", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] Creating event network-vif-plugged:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:38:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-e8c8bf00-f49e-4aec-90b0-afeba48b984c req-00298a6d-8942-40ba-87fd-44dc99653708 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Apr 11 23:38:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 363/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: ae9134ec-5953-49ad-b32f-a00a6310e497] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] HTTP exception thrown: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Request method failure captured: Apr 11 23:38:16 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 HTTP/1.1 Apr 11 23:38:16 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:38:16 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:38:16 user devstack@n-api.service[61861]: Connection: close Apr 11 23:38:16 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:38:16 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:38:16 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:38:16 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:38:16 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNe3JxGKUtcMns-F8AJrVfoVIstQDuspG02SGURXlvRM0UdPJD-tJdIGdzR719bsSAuBBpgLeV_LodOZD8OoLnueTcuuLSG2f47d-yv-mNV_3-oyQ9aeXmkDzMmsPFQmptmhaGXZZ12XQUCMgYaxNFUicT8YqW3ob-yif6g3WLkUoHvA Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Project-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Project-Name: tempest-TestStampPattern-1577365278 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6bef1ddbef124fff82634357a1db9594"}]}] Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Tenant: tempest-TestStampPattern-1577365278 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Tenant-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-TestStampPattern-1577365278 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-User: tempest-TestStampPattern-1577365278-project-member Apr 11 23:38:16 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:38:16 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:38:16 user devstack@n-api.service[61861]: X-User-Id: 3fba33ae43c34bbba115df1e892b2034 Apr 11 23:38:16 user devstack@n-api.service[61861]: X-User-Name: tempest-TestStampPattern-1577365278-project-member Apr 11 23:38:16 user devstack@n-api.service[61861]: method: > Apr 11 23:38:16 user devstack@n-api.service[61861]: exception: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. Apr 11 23:38:16 user devstack@n-api.service[61861]: action_args: {'id': 'ae9134ec-5953-49ad-b32f-a00a6310e497'} Apr 11 23:38:16 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. Apr 11 23:38:16 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:38:16 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Returning 404 to user: Instance ae9134ec-5953-49ad-b32f-a00a6310e497 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:38:16 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-69b68a1a-da96-4517-9b00-13390331b727 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497" status: 404 len: 111 microversion: 2.1 time: 0.035189 Apr 11 23:38:16 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 359/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:38:16 2023] GET /compute/v2.1/servers/ae9134ec-5953-49ad-b32f-a00a6310e497 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] HTTP exception thrown: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c is not attached to volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Request method failure captured: Apr 11 23:38:19 user devstack@n-api.service[61860]: request: DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments/a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 HTTP/1.1 Apr 11 23:38:19 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:38:19 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:38:19 user devstack@n-api.service[61860]: Connection: close Apr 11 23:38:19 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:38:19 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:38:19 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:38:19 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:38:19 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNe3JxGKUtcMns-F8AJrVfoVIstQDuspG02SGURXlvRM0UdPJD-tJdIGdzR719bsSAuBBpgLeV_LodOZD8OoLnueTcuuLSG2f47d-yv-mNV_3-oyQ9aeXmkDzMmsPFQmptmhaGXZZ12XQUCMgYaxNFUicT8YqW3ob-yif6g3WLkUoHvA Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Project-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Project-Name: tempest-TestStampPattern-1577365278 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6bef1ddbef124fff82634357a1db9594"}]}] Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Tenant: tempest-TestStampPattern-1577365278 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Tenant-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-TestStampPattern-1577365278 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-User: tempest-TestStampPattern-1577365278-project-member Apr 11 23:38:19 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:38:19 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:38:19 user devstack@n-api.service[61860]: X-User-Id: 3fba33ae43c34bbba115df1e892b2034 Apr 11 23:38:19 user devstack@n-api.service[61860]: X-User-Name: tempest-TestStampPattern-1577365278-project-member Apr 11 23:38:19 user devstack@n-api.service[61860]: method: > Apr 11 23:38:19 user devstack@n-api.service[61860]: exception: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c is not attached to volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 Apr 11 23:38:19 user devstack@n-api.service[61860]: action_args: {'server_id': '6daabd9b-ed06-4bfc-a323-e464f5e29b3c', 'id': 'a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4'} Apr 11 23:38:19 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4. Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c is not attached to volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c is not attached to volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 Apr 11 23:38:19 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:38:19 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Returning 404 to user: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c is not attached to volume a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:38:19 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-9235901f-32ca-4b06-90ef-67738c0a4738 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments/a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4" status: 404 len: 154 microversion: 2.1 time: 0.132398 Apr 11 23:38:19 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 359/1081] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 23:38:19 2023] DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c/os-volume_attachments/a23e3cfe-8e64-4bd2-968b-6b6d1841dcc4 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:19 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:19 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] Creating event network-changed:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:38:19 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-1c238aba-2357-446f-9322-4f7f1d065d3d req-f970a0f2-57b1-4388-8ad8-d32fe2b5be1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030838 Apr 11 23:38:19 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 360/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:19 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:38:20 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-9d85343a-fce0-40ba-a9e4-613e7fed0fc6 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 204 len: 0 microversion: 2.1 time: 0.121991 Apr 11 23:38:20 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 364/1083] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:38:19 2023] DELETE /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:20 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fba33ae43c34bbba115df1e892b2034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bef1ddbef124fff82634357a1db9594', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:20 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-66ec01cf-030b-43b1-a8a0-6958a0a1b7a1 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 200 len: 1662 microversion: 2.1 time: 0.184569 Apr 11 23:38:20 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 360/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:38:20 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 1662 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:38:20 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "name": "network-vif-unplugged", "status": "completed", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:20 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] Creating event network-vif-unplugged:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:38:20 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d2f9aad4-7f22-4ffb-9d70-ba7b9df39420 req-2377c7e4-6234-4edb-b356-d94ed4a2ee48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090630 Apr 11 23:38:20 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 361/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:21 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "name": "network-vif-deleted", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:21 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] Creating event network-vif-deleted:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:38:21 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-0ff551b8-b66c-48e2-a0d1-40eb9a56474f req-946f2405-fb65-4d8d-b1b4-9ba07cbdfca4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Apr 11 23:38:21 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 365/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:22 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6daabd9b-ed06-4bfc-a323-e464f5e29b3c", "name": "network-vif-plugged", "status": "completed", "tag": "5b75ff13-136e-4805-9959-478fe1165c45"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:38:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:22 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] Creating event network-vif-plugged:5b75ff13-136e-4805-9959-478fe1165c45 for instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c on user Apr 11 23:38:22 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-57ce9538-646f-4cb8-91d7-f81eae390c6e req-41cc75ed-c7c0-4dea-b2ae-b1793d376d66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Apr 11 23:38:22 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 361/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:38:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:54 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:38:54 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6cd8a09a-21b7-4903-ac1c-cf4f7b7b70d1 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 200 len: 1690 microversion: 2.87 time: 0.190456 Apr 11 23:38:54 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 362/1088] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:38:54 2023] GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] [instance: 6daabd9b-ed06-4bfc-a323-e464f5e29b3c] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:39:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] HTTP exception thrown: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Request method failure captured: Apr 11 23:39:10 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c HTTP/1.1 Apr 11 23:39:10 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:39:10 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:39:10 user devstack@n-api.service[61859]: Connection: close Apr 11 23:39:10 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:39:10 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:39:10 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:39:10 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:39:10 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNe3JxGKUtcMns-F8AJrVfoVIstQDuspG02SGURXlvRM0UdPJD-tJdIGdzR719bsSAuBBpgLeV_LodOZD8OoLnueTcuuLSG2f47d-yv-mNV_3-oyQ9aeXmkDzMmsPFQmptmhaGXZZ12XQUCMgYaxNFUicT8YqW3ob-yif6g3WLkUoHvA Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Project-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Project-Name: tempest-TestStampPattern-1577365278 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6bef1ddbef124fff82634357a1db9594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6bef1ddbef124fff82634357a1db9594"}]}] Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Tenant: tempest-TestStampPattern-1577365278 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Tenant-Id: 6bef1ddbef124fff82634357a1db9594 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-TestStampPattern-1577365278 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-User: tempest-TestStampPattern-1577365278-project-member Apr 11 23:39:10 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:39:10 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:39:10 user devstack@n-api.service[61859]: X-User-Id: 3fba33ae43c34bbba115df1e892b2034 Apr 11 23:39:10 user devstack@n-api.service[61859]: X-User-Name: tempest-TestStampPattern-1577365278-project-member Apr 11 23:39:10 user devstack@n-api.service[61859]: method: > Apr 11 23:39:10 user devstack@n-api.service[61859]: exception: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. Apr 11 23:39:10 user devstack@n-api.service[61859]: action_args: {'id': '6daabd9b-ed06-4bfc-a323-e464f5e29b3c'} Apr 11 23:39:10 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. Apr 11 23:39:10 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:39:10 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Returning 404 to user: Instance 6daabd9b-ed06-4bfc-a323-e464f5e29b3c could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:39:10 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c9905be5-f424-4a28-90f4-d442314045e4 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c" status: 404 len: 111 microversion: 2.1 time: 0.037445 Apr 11 23:39:10 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 366/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:39:10 2023] GET /compute/v2.1/servers/6daabd9b-ed06-4bfc-a323-e464f5e29b3c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:39:12 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-84d43b82-f88b-4641-b2e0-0b59e0a3b795 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] Calling method '.version_select at 0x7f315763f250>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:39:12 user devstack@n-api.service[61860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b3e711-5468-4eda-8508-45c8a2a17ba1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 23:39:12 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:12 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=14 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:12 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-84d43b82-f88b-4641-b2e0-0b59e0a3b795 tempest-TestStampPattern-1577365278 tempest-TestStampPattern-1577365278-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-718348001" status: 202 len: 0 microversion: 2.1 time: 0.035108 Apr 11 23:39:12 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 362/1090] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 23:39:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-718348001 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 23:39:54 user devstack@n-api.service[61861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-634968375"}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:39:54 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:39:55 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2c9b120c-6f15-401e-a5b8-a4fb60b89e32 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb/action" status: 202 len: 52 microversion: 2.87 time: 0.949512 Apr 11 23:39:55 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 363/1091] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:39:54 2023] POST /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb/action => generated 52 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:40:00 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:40:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-e0ca8966-54cf-475d-9ff9-fe28883f6f7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 200 len: 1690 microversion: 2.87 time: 0.169139 Apr 11 23:40:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 367/1092] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:40:00 2023] GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:01 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:41:01 user devstack@n-api.service[61860]: Tue Apr 11 23:41:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 23:41:01 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:41:01 user devstack@n-api.service[61860]: Tue Apr 11 23:41:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 23:41:01 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b3e711-5468-4eda-8508-45c8a2a17ba1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54476. Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-963770929", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "destination_type": "volume"}], "networks": [{"uuid": "d160dc36-a006-4029-9540-b148fec639df"}]}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.network.neutron [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] validate_networks() for [('d160dc36-a006-4029-9540-b148fec639df', None, None, None, None, None)] {{(pid=61860) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image limits 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Flavor pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Image pref 0:0:0 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.virt.hardware [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.quota [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Getting quotas for user 34d0482650674249adb77724a287d53e and project 5d1c7064a4f845d1b39a49795d00d9b0. Resources: {'cores', 'instances', 'ram'} {{(pid=61860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Going to run 1 instances... {{(pid=61860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:41:01 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:41:01 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5dcaa4d8-ce3b-4343-b980-cd87fe4a3b7b tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.879069 Apr 11 23:41:01 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 363/1093] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 23:41:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 23:41:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:01 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:01 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:41:01 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:41:01 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46716. Apr 11 23:41:02 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:02 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:02 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:02 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-c34b199e-82b4-4eb4-b078-01823ab34f69 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1394 microversion: 2.87 time: 0.104698 Apr 11 23:41:02 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 364/1094] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:41:01 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1394 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:41:04 user devstack@n-api.service[61859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:04 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:41:04 user devstack@n-api.service[61859]: Tue Apr 11 23:41:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:04 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] Creating event network-changed:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:41:04 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-95f6d8ca-9c78-4cc6-97e1-fd445c5b254a req-65548ac7-e5b7-44a3-adb8-13e455d16189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053339 Apr 11 23:41:04 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 368/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:41:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-bde4ad4a-7ac3-48fb-8b55-c2d1f39e93e7 req-93628342-356e-4d6f-a868-e9ac55bb8fc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046862 Apr 11 23:41:15 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 364/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell0:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:17 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:41:17 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-06c0e428-2bea-4439-935c-852d8a00d5c2 req-17b93d71-d097-4fb0-bf6d-bdf2c32ab283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040718 Apr 11 23:41:17 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 365/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:41:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:41:52 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34330. Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:52 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:41:52 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-4f5434d5-5cc7-4d7a-8fa1-b9a498ba0585 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1768 microversion: 2.87 time: 0.177579 Apr 11 23:41:52 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 369/1098] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:41:52 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1768 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:42:52 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:42:52 user devstack@n-api.service[61860]: Tue Apr 11 23:42:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/action (ip 10.0.0.210) !!! Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "9a2e42e2-df32-45d0-96c1-a0a05799dc5e"}} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:52 user devstack@n-api.service[61860]: DEBUG nova.objects.instance [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lazy-loading 'flavor' on Instance uuid 0a15bbee-baf2-4110-bcc5-a1f8daeb528d {{(pid=61860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 23:42:53 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-5df65f5c-8922-4c0c-9fe0-d83d7fac1c4f tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/action" status: 200 len: 29 microversion: 2.87 time: 0.573852 Apr 11 23:42:53 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 365/1099] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:42:52 2023] POST /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/action => generated 29 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:53 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:42:53 user devstack@n-api.service[61861]: Tue Apr 11 23:42:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:42:53 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:42:53 user devstack@n-api.service[61861]: Tue Apr 11 23:42:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:42:53 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:42:53 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-cd834790-9df7-4d70-a76f-42c9c59d2216 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1774 microversion: 2.87 time: 0.313288 Apr 11 23:42:53 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 366/1100] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:42:53 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1774 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:42:54 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:42:54 user devstack@n-api.service[61859]: Tue Apr 11 23:42:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:42:54 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:42:54 user devstack@n-api.service[61859]: Tue Apr 11 23:42:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:54 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:54 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] Creating event network-vif-unplugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:54 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-fbfa63cc-33d7-43ae-a3c7-cc5795d0e39d req-a9f9dbbe-4cff-4927-ad48-bafcfd8b65ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045126 Apr 11 23:42:54 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 370/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:42:56 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}, {"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}, {"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}, {"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}, {"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:42:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:56 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Creating event network-vif-unplugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:56 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-49a6cf1a-52df-4eeb-9fbc-1f9b5f106d11 req-a60eafe1-f87e-4366-bc8c-936258f4d61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.042069 Apr 11 23:42:56 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 366/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:42:56 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:42:58 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:42:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:42:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:42:58 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:42:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:42:58 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-cc660754-66a2-42b0-9361-bfd726b4af6f req-9e8323d2-21e5-43b0-a854-a34398202924 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037763 Apr 11 23:42:58 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 367/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:43:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:43:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:43:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:43:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:43:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:43:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-11a8914f-d71d-4233-97b2-879dfb4d00f7 req-5f8e5318-50b6-4142-a97e-6a1d1c3b8402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039053 Apr 11 23:43:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:43:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:43:43 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:43:43 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-4474695f-6106-4360-810e-66d37dba68cf tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1754 microversion: 2.87 time: 0.252545 Apr 11 23:43:43 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 367/1105] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:43:43 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=8 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:43 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:43 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-31a26916-81e0-4fa9-b338-f29887610089 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/action" status: 202 len: 0 microversion: 2.87 time: 0.092056 Apr 11 23:44:43 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 368/1106] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 23:44:43 2023] POST /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:43 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:44 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:44:44 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:44:44 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:44:44 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b74b01c1-6958-453b-b9f8-7a3cad086e40 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1762 microversion: 2.87 time: 0.265570 Apr 11 23:44:44 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 372/1107] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:44:43 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1762 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:44:44 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:44:44 user devstack@n-api.service[61860]: Tue Apr 11 23:44:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:44 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] Creating event network-vif-unplugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:44:44 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-ecfe39d4-b89f-40b6-8a02-38ac4a2aab0e req-12940c70-3963-46b9-992a-5bf91385419d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142152 Apr 11 23:44:44 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 368/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:44:46 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}, {"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:44:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:46 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:44:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:44:46 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-09b2b2b8-b632-452c-b8a0-e96b9dac6a5f req-a66d29b2-0680-4b21-9ffb-153d16081689 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036675 Apr 11 23:44:46 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:44:48 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:44:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:44:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:44:48 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:44:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:44:48 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-4b14fd4c-954f-40ab-95ed-e314d8599002 req-0459963a-825c-41a7-bee5-38e6fb21f5f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Apr 11 23:44:48 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 373/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:45:34 user devstack@n-api.service[61860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b3e711-5468-4eda-8508-45c8a2a17ba1] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:45:34 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:45:34 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-6b381861-966c-4658-b053-30744e5e6de6 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1768 microversion: 2.87 time: 0.170362 Apr 11 23:45:34 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 369/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:45:34 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1768 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:34 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:46:34 user devstack@n-api.service[61861]: Tue Apr 11 23:46:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:46:34 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:46:34 user devstack@n-api.service[61861]: Tue Apr 11 23:46:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:34 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:46:34 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-154b77e0-1251-4938-8027-41f6e051f393 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 204 len: 0 microversion: 2.87 time: 0.222290 Apr 11 23:46:34 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 370/1112] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:46:34 2023] DELETE /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:46:34 user devstack@n-api.service[61859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:34 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:46:34 user devstack@n-api.service[61859]: Tue Apr 11 23:46:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:46:34 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:46:34 user devstack@n-api.service[61859]: Tue Apr 11 23:46:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d (ip 10.0.0.210) !!! Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:46:34 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:46:34 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6838efe1-2f74-4216-98c6-aa8115ab2745 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 200 len: 1774 microversion: 2.87 time: 0.243746 Apr 11 23:46:34 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 374/1113] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:46:34 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 1774 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-unplugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:35 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:35 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] [34b3e711-5468-4eda-8508-45c8a2a17ba1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34236. Apr 11 23:46:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] Creating event network-vif-unplugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:46:35 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-095f5c8e-9b41-4823-9991-4c7b368aac9f req-a8036704-db1e-4c6a-a6f6-02462a8b46e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037483 Apr 11 23:46:35 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 370/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:46:36 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-deleted", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:46:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:36 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] Creating event network-vif-deleted:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:46:36 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-ea638d86-9a92-4d5f-91b9-39f144988e32 req-a8796194-4f0c-4e8c-833d-69504dabc6a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090899 Apr 11 23:46:36 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 371/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:46:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:46:37 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a15bbee-baf2-4110-bcc5-a1f8daeb528d", "name": "network-vif-plugged", "status": "completed", "tag": "b6e46a90-8968-4861-8d7c-f67e22a8addc"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:46:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:46:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:46:37 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:46:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] Creating event network-vif-plugged:b6e46a90-8968-4861-8d7c-f67e22a8addc for instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d on user Apr 11 23:46:37 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-1bcb5c21-1bc7-4000-bb00-a2a034b89ba2 req-eb21960f-c95c-4909-b247-c29bb0d6a94e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048728 Apr 11 23:46:37 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 375/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 0a15bbee-baf2-4110-bcc5-a1f8daeb528d] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HTTP exception thrown: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Request method failure captured: Apr 11 23:47:25 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d HTTP/1.1 Apr 11 23:47:25 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:47:25 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:47:25 user devstack@n-api.service[61860]: Connection: close Apr 11 23:47:25 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:47:25 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:47:25 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:47:25 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:47:25 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNe1b581RhT_fRVFtM9AAO0A0hB6cEOGDzYGehXqbMh3LpQLTKv5r3EjmBufzXMTm3WfWIm6zz4PtgkDmIkZ3Lpw9aU0L4dI2B6O5J20HYokaMuyfOH3M1ZMyX5ecy_bJ4PIGtCm7JJ2OAtW2CpMYs3HZIua4purl9MW4xvcNoi5tlqA Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Project-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5d1c7064a4f845d1b39a49795d00d9b0"}]}] Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Tenant-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:47:25 user devstack@n-api.service[61860]: X-User: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:47:25 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:47:25 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:47:25 user devstack@n-api.service[61860]: X-User-Id: 34d0482650674249adb77724a287d53e Apr 11 23:47:25 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:47:25 user devstack@n-api.service[61860]: method: > Apr 11 23:47:25 user devstack@n-api.service[61860]: exception: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. Apr 11 23:47:25 user devstack@n-api.service[61860]: action_args: {'id': '0a15bbee-baf2-4110-bcc5-a1f8daeb528d'} Apr 11 23:47:25 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. Apr 11 23:47:25 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Returning 404 to user: Instance 0a15bbee-baf2-4110-bcc5-a1f8daeb528d could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:47:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-89dbe7b5-ec39-408a-aea9-e419da7f018c tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d" status: 404 len: 111 microversion: 2.87 time: 0.040516 Apr 11 23:47:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 371/1117] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:47:25 2023] GET /compute/v2.1/servers/0a15bbee-baf2-4110-bcc5-a1f8daeb528d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:47:25 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-ef0f40ea-d013-4bb5-9970-fe053f995aed tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 204 len: 0 microversion: 2.87 time: 0.153359 Apr 11 23:47:25 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 372/1118] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:47:25 2023] DELETE /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:47:25 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34244. Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:47:25 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:47:25 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-862060a3-adf9-41cd-9312-e8a564b9ffd4 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 200 len: 1696 microversion: 2.87 time: 0.213955 Apr 11 23:47:25 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 376/1119] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:47:25 2023] GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "name": "network-vif-unplugged", "status": "completed", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] Creating event network-vif-unplugged:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:47:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-c681b6c2-14e8-4121-8624-c6a8210377c3 req-1a1db596-9bb1-4b28-9ca8-a26f5b772550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098665 Apr 11 23:47:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 372/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:47:26 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "name": "network-vif-deleted", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:47:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:26 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] Creating event network-vif-deleted:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:47:26 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-6a1740a4-075f-4141-9949-64c017654085 req-b4bb251b-0f00-424f-a5e0-ccb1921a2986 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Apr 11 23:47:26 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 373/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:47:27 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b986da-959f-4183-8f01-70cd5fab90fb", "name": "network-vif-plugged", "status": "completed", "tag": "72c117df-79e3-423b-952f-6f716efb70e0"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:47:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:47:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:47:27 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:47:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] Creating event network-vif-plugged:72c117df-79e3-423b-952f-6f716efb70e0 for instance 22b986da-959f-4183-8f01-70cd5fab90fb on user Apr 11 23:47:27 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-bec6e9f8-8dcc-4eec-8f0f-2d4f7cb65107 req-3fe64ce6-5304-4783-a824-31ec7709255e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028938 Apr 11 23:47:27 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 377/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 22b986da-959f-4183-8f01-70cd5fab90fb] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.wsgi [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HTTP exception thrown: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Request method failure captured: Apr 11 23:48:15 user devstack@n-api.service[61860]: request: GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb HTTP/1.1 Apr 11 23:48:15 user devstack@n-api.service[61860]: Accept: application/json Apr 11 23:48:15 user devstack@n-api.service[61860]: Accept-Encoding: identity Apr 11 23:48:15 user devstack@n-api.service[61860]: Connection: close Apr 11 23:48:15 user devstack@n-api.service[61860]: Content-Length: 0 Apr 11 23:48:15 user devstack@n-api.service[61860]: Content-Type: application/json Apr 11 23:48:15 user devstack@n-api.service[61860]: Host: 10.0.0.210 Apr 11 23:48:15 user devstack@n-api.service[61860]: Openstack-System-Scope: None Apr 11 23:48:15 user devstack@n-api.service[61860]: User-Agent: python-urllib3/1.26.15 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Auth-Token: gAAAAABkNe1b581RhT_fRVFtM9AAO0A0hB6cEOGDzYGehXqbMh3LpQLTKv5r3EjmBufzXMTm3WfWIm6zz4PtgkDmIkZ3Lpw9aU0L4dI2B6O5J20HYokaMuyfOH3M1ZMyX5ecy_bJ4PIGtCm7JJ2OAtW2CpMYs3HZIua4purl9MW4xvcNoi5tlqA Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Domain-Id: None Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Domain-Name: None Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Identity-Status: Confirmed Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Is-Admin-Project: True Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Project-Domain-Id: default Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Project-Domain-Name: Default Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Project-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Role: member,reader Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Roles: member,reader Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5d1c7064a4f845d1b39a49795d00d9b0"}]}] Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Tenant-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:48:15 user devstack@n-api.service[61860]: X-User: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:48:15 user devstack@n-api.service[61860]: X-User-Domain-Id: default Apr 11 23:48:15 user devstack@n-api.service[61860]: X-User-Domain-Name: Default Apr 11 23:48:15 user devstack@n-api.service[61860]: X-User-Id: 34d0482650674249adb77724a287d53e Apr 11 23:48:15 user devstack@n-api.service[61860]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:48:15 user devstack@n-api.service[61860]: method: > Apr 11 23:48:15 user devstack@n-api.service[61860]: exception: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. Apr 11 23:48:15 user devstack@n-api.service[61860]: action_args: {'id': '22b986da-959f-4183-8f01-70cd5fab90fb'} Apr 11 23:48:15 user devstack@n-api.service[61860]: {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. Apr 11 23:48:15 user devstack@n-api.service[61860]: ERROR nova.api.openstack.wsgi Apr 11 23:48:15 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Returning 404 to user: Instance 22b986da-959f-4183-8f01-70cd5fab90fb could not be found. {{(pid=61860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:48:15 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-d1fb7df6-200c-4cc8-b10c-658cf59aff4e tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb" status: 404 len: 111 microversion: 2.87 time: 0.035671 Apr 11 23:48:15 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 373/1123] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:48:15 2023] GET /compute/v2.1/servers/22b986da-959f-4183-8f01-70cd5fab90fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:15 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Going to try to terminate instance {{(pid=61861) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:48:15 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-58dd75ec-5166-4582-90e2-7b12cc5b1d84 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 204 len: 0 microversion: 2.87 time: 0.127569 Apr 11 23:48:15 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 374/1124] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:48:15 2023] DELETE /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=8 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:15 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:16 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:48:16 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:48:16 user devstack@n-api.service[61859]: DEBUG nova.policy [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61859) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:48:16 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-537ab0a9-46e6-4fe4-b82a-598382df5bca tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 200 len: 1773 microversion: 2.87 time: 0.182828 Apr 11 23:48:16 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 378/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:48:15 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 1773 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:48:16 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-unplugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:48:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:16 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] Creating event network-vif-unplugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:48:16 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-4ef41097-09dd-4134-8d49-207a15cd50f4 req-c42f6fd2-33d2-4305-8372-0e147a36319c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030946 Apr 11 23:48:16 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 374/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:48:18 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-plugged", "status": "completed", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}, {"server_uuid": "16682788-70d1-400d-adc3-0518282c04fa", "name": "network-vif-deleted", "tag": "624afba1-f295-47d2-8419-91f51beeb2a8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:48:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:48:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:48:18 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:48:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Creating event network-vif-plugged:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:48:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] Creating event network-vif-deleted:624afba1-f295-47d2-8419-91f51beeb2a8 for instance 16682788-70d1-400d-adc3-0518282c04fa on user Apr 11 23:48:18 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-0aa24a66-510a-4ba6-b863-5f9b9cb13a6a req-02f19c3c-46d0-45c5-8b3f-fe717761a539 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032618 Apr 11 23:48:18 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 375/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: 16682788-70d1-400d-adc3-0518282c04fa] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.wsgi [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HTTP exception thrown: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Request method failure captured: Apr 11 23:49:06 user devstack@n-api.service[61859]: request: GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa HTTP/1.1 Apr 11 23:49:06 user devstack@n-api.service[61859]: Accept: application/json Apr 11 23:49:06 user devstack@n-api.service[61859]: Accept-Encoding: identity Apr 11 23:49:06 user devstack@n-api.service[61859]: Connection: close Apr 11 23:49:06 user devstack@n-api.service[61859]: Content-Length: 0 Apr 11 23:49:06 user devstack@n-api.service[61859]: Content-Type: application/json Apr 11 23:49:06 user devstack@n-api.service[61859]: Host: 10.0.0.210 Apr 11 23:49:06 user devstack@n-api.service[61859]: Openstack-System-Scope: None Apr 11 23:49:06 user devstack@n-api.service[61859]: User-Agent: python-urllib3/1.26.15 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Auth-Token: gAAAAABkNe1b581RhT_fRVFtM9AAO0A0hB6cEOGDzYGehXqbMh3LpQLTKv5r3EjmBufzXMTm3WfWIm6zz4PtgkDmIkZ3Lpw9aU0L4dI2B6O5J20HYokaMuyfOH3M1ZMyX5ecy_bJ4PIGtCm7JJ2OAtW2CpMYs3HZIua4purl9MW4xvcNoi5tlqA Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Domain-Id: None Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Domain-Name: None Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Identity-Status: Confirmed Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Is-Admin-Project: True Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Project-Domain-Id: default Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Project-Domain-Name: Default Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Project-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Role: member,reader Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Roles: member,reader Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5d1c7064a4f845d1b39a49795d00d9b0"}]}] Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Tenant-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:06 user devstack@n-api.service[61859]: X-User: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:49:06 user devstack@n-api.service[61859]: X-User-Domain-Id: default Apr 11 23:49:06 user devstack@n-api.service[61859]: X-User-Domain-Name: Default Apr 11 23:49:06 user devstack@n-api.service[61859]: X-User-Id: 34d0482650674249adb77724a287d53e Apr 11 23:49:06 user devstack@n-api.service[61859]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:49:06 user devstack@n-api.service[61859]: method: > Apr 11 23:49:06 user devstack@n-api.service[61859]: exception: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. Apr 11 23:49:06 user devstack@n-api.service[61859]: action_args: {'id': '16682788-70d1-400d-adc3-0518282c04fa'} Apr 11 23:49:06 user devstack@n-api.service[61859]: {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. Apr 11 23:49:06 user devstack@n-api.service[61859]: ERROR nova.api.openstack.wsgi Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Returning 404 to user: Instance 16682788-70d1-400d-adc3-0518282c04fa could not be found. {{(pid=61859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:49:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-6d4f1a6e-7471-4ff1-9778-ff2ce41c6842 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa" status: 404 len: 111 microversion: 2.87 time: 0.037480 Apr 11 23:49:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 379/1128] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:49:06 2023] GET /compute/v2.1/servers/16682788-70d1-400d-adc3-0518282c04fa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:49:06 user devstack@n-api.service[61860]: Tue Apr 11 23:49:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b (ip 10.0.0.210) !!! Apr 11 23:49:06 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:49:06 user devstack@n-api.service[61860]: Tue Apr 11 23:49:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b (ip 10.0.0.210) !!! Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Going to try to terminate instance {{(pid=61860) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:49:06 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-a05a11ed-83ca-4365-ae3d-3262a1fbc406 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 204 len: 0 microversion: 2.87 time: 0.136046 Apr 11 23:49:06 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 375/1129] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 23:49:06 2023] DELETE /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:49:06 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34d0482650674249adb77724a287d53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1c7064a4f845d1b39a49795d00d9b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:49:06 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-6074e111-ee4f-4952-bc92-871f38368651 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 200 len: 1695 microversion: 2.87 time: 0.278701 Apr 11 23:49:06 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 376/1130] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:49:06 2023] GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 1695 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "name": "network-vif-unplugged", "status": "completed", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:06 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] Creating event network-vif-unplugged:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:49:06 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-c204d6bd-65bb-4699-9aa9-8b8f5c62efc3 req-3923e670-177d-4d21-85d1-172d472a83d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028937 Apr 11 23:49:06 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 380/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:49:08 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "name": "network-vif-plugged", "status": "completed", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}, {"server_uuid": "cd42372d-ba80-46bb-8ebb-712e6941d62b", "name": "network-vif-deleted", "tag": "b9392b00-89bf-40ad-bcfa-4278fa388813"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:49:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:08 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Creating event network-vif-plugged:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:49:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] Creating event network-vif-deleted:b9392b00-89bf-40ad-bcfa-4278fa388813 for instance cd42372d-ba80-46bb-8ebb-712e6941d62b on user Apr 11 23:49:08 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9dd48014-3311-4237-ad1e-8e2e6385e513 req-5ee50d10-fd1b-4aa9-a1c0-a8f6afb5274e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029003 Apr 11 23:49:08 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 376/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] [instance: cd42372d-ba80-46bb-8ebb-712e6941d62b] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:49:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] HTTP exception thrown: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Request method failure captured: Apr 11 23:49:56 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b HTTP/1.1 Apr 11 23:49:56 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:49:56 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:49:56 user devstack@n-api.service[61861]: Connection: close Apr 11 23:49:56 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:49:56 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:49:56 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:49:56 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:49:56 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNe1b581RhT_fRVFtM9AAO0A0hB6cEOGDzYGehXqbMh3LpQLTKv5r3EjmBufzXMTm3WfWIm6zz4PtgkDmIkZ3Lpw9aU0L4dI2B6O5J20HYokaMuyfOH3M1ZMyX5ecy_bJ4PIGtCm7JJ2OAtW2CpMYs3HZIua4purl9MW4xvcNoi5tlqA Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Project-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d1c7064a4f845d1b39a49795d00d9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5d1c7064a4f845d1b39a49795d00d9b0"}]}] Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Tenant-Id: 5d1c7064a4f845d1b39a49795d00d9b0 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051 Apr 11 23:49:56 user devstack@n-api.service[61861]: X-User: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:49:56 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:49:56 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:49:56 user devstack@n-api.service[61861]: X-User-Id: 34d0482650674249adb77724a287d53e Apr 11 23:49:56 user devstack@n-api.service[61861]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member Apr 11 23:49:56 user devstack@n-api.service[61861]: method: > Apr 11 23:49:56 user devstack@n-api.service[61861]: exception: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. Apr 11 23:49:56 user devstack@n-api.service[61861]: action_args: {'id': 'cd42372d-ba80-46bb-8ebb-712e6941d62b'} Apr 11 23:49:56 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. Apr 11 23:49:56 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:49:56 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] Returning 404 to user: Instance cd42372d-ba80-46bb-8ebb-712e6941d62b could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:49:56 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-2f4effd7-60b8-4e95-b6c2-2f55363aac14 tempest-ServerBootFromVolumeStableRescueTest-948037051 tempest-ServerBootFromVolumeStableRescueTest-948037051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b" status: 404 len: 111 microversion: 2.87 time: 0.045476 Apr 11 23:49:56 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 377/1133] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 23:49:56 2023] GET /compute/v2.1/servers/cd42372d-ba80-46bb-8ebb-712e6941d62b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 23:50:17 user devstack@n-api.service[61859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:50:17 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:17 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:17 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-365157374", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "80dd1095-f55e-41b1-bf6b-6c453525f0b8"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] validate_networks() for [('80dd1095-f55e-41b1-bf6b-6c453525f0b8', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting quotas for project 52014401b1a74ddcb07e284fb081d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting quotas for user 4660aa9abec348f5a999a753be05b3e7 and project 52014401b1a74ddcb07e284fb081d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:50:18 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:50:18 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-bbff4a89-2b1c-4209-972c-0f122759bf19 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.730440 Apr 11 23:50:18 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 381/1134] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:50:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:50:18 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:18 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:18 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-551395af-4e53-46d8-a044-c377d7573a00 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:50:18 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-551395af-4e53-46d8-a044-c377d7573a00 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:50:18 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-551395af-4e53-46d8-a044-c377d7573a00 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:50:18 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-551395af-4e53-46d8-a044-c377d7573a00 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba" status: 200 len: 1207 microversion: 2.1 time: 0.148051 Apr 11 23:50:18 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 377/1135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:50:18 2023] GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba => generated 1207 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:50:21 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:50:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] Creating event network-changed:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:50:21 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-25079d34-ad84-42e9-961a-a6d7da4ea638 req-4f8605a7-549c-4736-a72e-b08428308366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071935 Apr 11 23:50:21 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 378/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:50:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:50:23 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "name": "network-vif-plugged", "status": "completed", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:50:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:50:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:50:23 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:50:23 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 46754. Apr 11 23:50:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] Creating event network-vif-plugged:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:50:23 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-884c7a35-4a5c-413d-b76f-77cb7c452c82 req-01d7a5eb-1edc-4fce-b631-729edde2af0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053611 Apr 11 23:50:23 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 382/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:50:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:50:25 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "name": "network-vif-plugged", "status": "completed", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:50:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:50:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:50:25 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:50:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] Creating event network-vif-plugged:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:50:25 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-cfdaf7ba-dfa6-4432-b368-20823d4f7b90 req-de0beac4-5f99-4d2a-83b2-e1e366330e33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036999 Apr 11 23:50:25 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 378/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:51:08 user devstack@n-api.service[61861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:51:08 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:51:09 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:51:09 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-a31ef291-b583-4573-9d72-ce11d3223878 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba" status: 200 len: 1485 microversion: 2.1 time: 0.249502 Apr 11 23:51:09 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 379/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:51:08 2023] GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba => generated 1485 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:52:09 user devstack@n-api.service[61859]: Tue Apr 11 23:52:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba (ip 10.0.0.210) !!! Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:09 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:52:09 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-89df3d0a-5627-4043-a497-478e9100cc1d tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba" status: 204 len: 0 microversion: 2.1 time: 0.171909 Apr 11 23:52:09 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 383/1140] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:52:09 2023] DELETE /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:52:09 user devstack@n-api.service[61860]: Tue Apr 11 23:52:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba (ip 10.0.0.210) !!! Apr 11 23:52:09 user devstack@n-api.service[61860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:52:09 user devstack@n-api.service[61860]: Tue Apr 11 23:52:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba (ip 10.0.0.210) !!! Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:09 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:10 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:52:10 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-e9e6a104-2717-4032-a836-19b5ac2478d0 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba" status: 200 len: 1491 microversion: 2.1 time: 0.249566 Apr 11 23:52:10 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 379/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:52:09 2023] GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba => generated 1491 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "name": "network-vif-unplugged", "status": "completed", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:10 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] Creating event network-vif-unplugged:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:52:10 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d0a5fbf4-e3bd-4207-91d3-34d830029c48 req-3a28e45c-330f-4ae0-8638-65ddad9106d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041176 Apr 11 23:52:10 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 380/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:52:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:52:11 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "name": "network-vif-deleted", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:52:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:11 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] Creating event network-vif-deleted:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:52:11 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-d161505d-ee3f-4468-ab38-51ac670e02d9 req-cb98d644-6fbb-4d3b-bf48-7cddf8f1d406 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117254 Apr 11 23:52:11 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 384/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:52:12 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102fc1ab-bee7-4f14-a9de-729b521eb8ba", "name": "network-vif-plugged", "status": "completed", "tag": "0d43f907-d7ec-4016-bf54-c9dd4ded6cf8"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:52:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:52:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:52:12 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:52:12 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] Creating event network-vif-plugged:0d43f907-d7ec-4016-bf54-c9dd4ded6cf8 for instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba on user Apr 11 23:52:12 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-9f59b70f-16f5-4ea7-aab9-1fd936ab7fe5 req-7cfa0d51-7ca1-41c6-9bbd-080e79cb9b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Apr 11 23:52:12 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 380/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:52:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 102fc1ab-bee7-4f14-a9de-729b521eb8ba] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:53:00 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43736. Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] HTTP exception thrown: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Request method failure captured: Apr 11 23:53:00 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba HTTP/1.1 Apr 11 23:53:00 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:53:00 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:53:00 user devstack@n-api.service[61861]: Connection: close Apr 11 23:53:00 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:53:00 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:53:00 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:53:00 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:53:00 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNfI4ugHG4A9ovAp3W4Rzt5PUqxRTutdV7lVMwYcvEEZXqvP2s25W6p0keoZO__H1jE6WTc4iGeiROLtcT8R2IwVaT9gJZ37C_q782L7kN6Ce7Ah1-v4o6RoTZg0ZbgAfPAOtqQDwA0X1BQPhyXPmBj37pzOWlZVfAawT_OgY8be7JMw Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Project-Id: 52014401b1a74ddcb07e284fb081d5bc Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesActionsTest-1048592318 Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52014401b1a74ddcb07e284fb081d5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52014401b1a74ddcb07e284fb081d5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52014401b1a74ddcb07e284fb081d5bc"}]}] Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesActionsTest-1048592318 Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Tenant-Id: 52014401b1a74ddcb07e284fb081d5bc Apr 11 23:53:00 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesActionsTest-1048592318 Apr 11 23:53:00 user devstack@n-api.service[61861]: X-User: tempest-VolumesActionsTest-1048592318-project-member Apr 11 23:53:00 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:53:00 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:53:00 user devstack@n-api.service[61861]: X-User-Id: 4660aa9abec348f5a999a753be05b3e7 Apr 11 23:53:00 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesActionsTest-1048592318-project-member Apr 11 23:53:00 user devstack@n-api.service[61861]: method: > Apr 11 23:53:00 user devstack@n-api.service[61861]: exception: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. Apr 11 23:53:00 user devstack@n-api.service[61861]: action_args: {'id': '102fc1ab-bee7-4f14-a9de-729b521eb8ba'} Apr 11 23:53:00 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. Apr 11 23:53:00 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:53:00 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Returning 404 to user: Instance 102fc1ab-bee7-4f14-a9de-729b521eb8ba could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:53:00 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-dfa46b93-b95e-4256-950c-f2e4cb11ebd6 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba" status: 404 len: 111 microversion: 2.1 time: 0.042497 Apr 11 23:53:00 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:53:00 2023] GET /compute/v2.1/servers/102fc1ab-bee7-4f14-a9de-729b521eb8ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 11 23:53:00 user devstack@n-api.service[61859]: Tue Apr 11 23:53:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1458020268", "imageRef": "1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a", "flavorRef": "42", "networks": [{"uuid": "80dd1095-f55e-41b1-bf6b-6c453525f0b8"}]}} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.network.neutron [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] validate_networks() for [('80dd1095-f55e-41b1-bf6b-6c453525f0b8', None, None, None, None, None)] {{(pid=61859) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image limits 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Flavor pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Image pref 0:0:0 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.virt.hardware [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting quotas for project 52014401b1a74ddcb07e284fb081d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.quota [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Getting quotas for user 4660aa9abec348f5a999a753be05b3e7 and project 52014401b1a74ddcb07e284fb081d5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=61859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Going to run 1 instances... {{(pid=61859) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 23:53:00 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a90f79f-d29a-4e6f-9cab-38ee17d3ba0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 23:53:00 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-b762526a-684d-4183-8dbf-2e7e9af6a0ba tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.521798 Apr 11 23:53:00 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 385/1146] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 23:53:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 23:53:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=4 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=8 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:00 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-93f3bfea-c915-476f-abc8-5809c36b5704 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:53:00 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-93f3bfea-c915-476f-abc8-5809c36b5704 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:53:00 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-93f3bfea-c915-476f-abc8-5809c36b5704 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:53:00 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-93f3bfea-c915-476f-abc8-5809c36b5704 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680" status: 200 len: 1208 microversion: 2.1 time: 0.080280 Apr 11 23:53:00 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 381/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:53:00 2023] GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:53:03 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947314be-5091-4765-9855-5dd715371680", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:53:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:03 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] Creating event network-changed:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:53:03 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-d16529aa-1545-4408-af31-ef2bc882ea04 req-ea2ac641-c790-436f-9078-5b256b0f8761 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036866 Apr 11 23:53:03 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 382/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:53:05 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:53:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:05 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:53:05 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-44cc6980-473d-4b5d-89d4-6017b812c299 req-23223700-9003-4559-b32f-f75daf888719 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092197 Apr 11 23:53:05 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 386/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:53:07 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:53:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:07 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:53:07 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-c92bc9c2-766f-48b2-842c-45d618690566 req-21e16031-5d19-4085-b9c2-9e5f8aec36f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Apr 11 23:53:07 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 382/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=4 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:53:50 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:53:50 user devstack@n-api.service[61861]: Tue Apr 11 23:53:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 (ip 10.0.0.210) !!! Apr 11 23:53:50 user devstack@n-api.service[61861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 23:53:50 user devstack@n-api.service[61861]: Tue Apr 11 23:53:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 (ip 10.0.0.210) !!! Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:53:50 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:53:51 user devstack@n-api.service[61861]: DEBUG nova.policy [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61861) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:53:51 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-46472a3c-c9e1-45d2-88d9-abb07b24e7b2 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680" status: 200 len: 1485 microversion: 2.1 time: 0.177051 Apr 11 23:53:51 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 383/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:53:50 2023] GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 => generated 1485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 23:54:51 user devstack@n-api.service[61859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff66c66f-733f-4b85-ba67-54db2ca0e7f4] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=2 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell0:SELECT=6 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG dbcounter [-] [61859] Writing DB stats nova_cell1:SELECT=4 {{(pid=61859) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Fetching instance by UUID {{(pid=61859) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:51 user devstack@n-api.service[61859]: DEBUG nova.compute.api [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Going to try to terminate instance {{(pid=61859) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 23:54:51 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [None req-c64ad813-6459-4aeb-a0c7-ab0031a2a3d7 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680" status: 204 len: 0 microversion: 2.1 time: 0.166509 Apr 11 23:54:51 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 387/1152] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 23:54:51 2023] DELETE /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 23:54:51 user devstack@n-api.service[61860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34b3e711-5468-4eda-8508-45c8a2a17ba1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell0:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_api:SELECT=6 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG dbcounter [-] [61860] Writing DB stats nova_cell1:SELECT=2 {{(pid=61860) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG nova.compute.api [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Fetching instance by UUID {{(pid=61860) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:51 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:52 user devstack@n-api.service[61860]: DEBUG nova.policy [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660aa9abec348f5a999a753be05b3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52014401b1a74ddcb07e284fb081d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61860) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 23:54:52 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [None req-bfad841f-8a36-4102-9974-8e8ab5fbe642 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680" status: 200 len: 1491 microversion: 2.1 time: 0.246541 Apr 11 23:54:52 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 383/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:54:51 2023] GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 => generated 1491 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=6 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-unplugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:52 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.compute.server_external_events [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] Creating event network-vif-unplugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:52 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [req-9c0c37f2-5ccf-4aea-b6b2-ecf1bb9dfbd1 req-1c47151f-442a-4764-9b3b-c5367e724988 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036727 Apr 11 23:54:52 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 384/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:54:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:54:53 user devstack@n-api.service[61859]: DEBUG nova.api.openstack.wsgi [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-deleted", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:54:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:53 user devstack@n-api.service[61859]: DEBUG oslo_concurrency.lockutils [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61859) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.compute.server_external_events [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] Creating event network-vif-deleted:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:53 user devstack@n-api.service[61859]: INFO nova.api.openstack.requestlog [req-b7552f23-ebb6-4d9a-a5fc-0054ae1596d5 req-f3f09732-4fbc-40ad-8d13-8f07cdd2ea29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Apr 11 23:54:53 user devstack@n-api.service[61859]: [pid: 61859|app: 0|req: 388/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:54:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:54:54 user devstack@n-api.service[61860]: DEBUG nova.api.openstack.wsgi [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}, {"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}, {"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}, {"server_uuid": "947314be-5091-4765-9855-5dd715371680", "name": "network-vif-plugged", "status": "completed", "tag": "ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382"}]} {{(pid=61860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 23:54:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:54:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:54:54 user devstack@n-api.service[61860]: DEBUG oslo_concurrency.lockutils [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61860) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:54:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.compute.server_external_events [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] Creating event network-vif-plugged:ae0a33a2-d9a6-4d2e-b47c-b4c93d91c382 for instance 947314be-5091-4765-9855-5dd715371680 on user Apr 11 23:54:54 user devstack@n-api.service[61860]: INFO nova.api.openstack.requestlog [req-2a04a7b2-dd77-4ee1-910d-5d50f5e87f57 req-f7eb292e-b690-4604-b0f9-80784e2afbab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032533 Apr 11 23:54:54 user devstack@n-api.service[61860]: [pid: 61860|app: 0|req: 384/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 23:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [783231a1-300d-41d8-a67f-517eb592290d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_api:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG dbcounter [-] [61861] Writing DB stats nova_cell1:SELECT=2 {{(pid=61861) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Calling method '>' {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG nova.compute.api [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] [instance: 947314be-5091-4765-9855-5dd715371680] Fetching instance by UUID {{(pid=61861) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Acquiring lock "2a93e25b-84a6-4387-9884-7b542e9fed94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG oslo_concurrency.lockutils [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Lock "2a93e25b-84a6-4387-9884-7b542e9fed94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61861) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 23:55:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.wsgi [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] HTTP exception thrown: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Request method failure captured: Apr 11 23:55:42 user devstack@n-api.service[61861]: request: GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 HTTP/1.1 Apr 11 23:55:42 user devstack@n-api.service[61861]: Accept: application/json Apr 11 23:55:42 user devstack@n-api.service[61861]: Accept-Encoding: identity Apr 11 23:55:42 user devstack@n-api.service[61861]: Connection: close Apr 11 23:55:42 user devstack@n-api.service[61861]: Content-Length: 0 Apr 11 23:55:42 user devstack@n-api.service[61861]: Content-Type: application/json Apr 11 23:55:42 user devstack@n-api.service[61861]: Host: 10.0.0.210 Apr 11 23:55:42 user devstack@n-api.service[61861]: Openstack-System-Scope: None Apr 11 23:55:42 user devstack@n-api.service[61861]: User-Agent: python-urllib3/1.26.15 Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Auth-Token: gAAAAABkNfI4ugHG4A9ovAp3W4Rzt5PUqxRTutdV7lVMwYcvEEZXqvP2s25W6p0keoZO__H1jE6WTc4iGeiROLtcT8R2IwVaT9gJZ37C_q782L7kN6Ce7Ah1-v4o6RoTZg0ZbgAfPAOtqQDwA0X1BQPhyXPmBj37pzOWlZVfAawT_OgY8be7JMw Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Domain-Id: None Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Domain-Name: None Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Identity-Status: Confirmed Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Is-Admin-Project: True Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Project-Domain-Id: default Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Project-Domain-Name: Default Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Project-Id: 52014401b1a74ddcb07e284fb081d5bc Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Project-Name: tempest-VolumesActionsTest-1048592318 Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Role: member,reader Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Roles: member,reader Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52014401b1a74ddcb07e284fb081d5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/52014401b1a74ddcb07e284fb081d5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/52014401b1a74ddcb07e284fb081d5bc"}]}] Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Tenant: tempest-VolumesActionsTest-1048592318 Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Tenant-Id: 52014401b1a74ddcb07e284fb081d5bc Apr 11 23:55:42 user devstack@n-api.service[61861]: X-Tenant-Name: tempest-VolumesActionsTest-1048592318 Apr 11 23:55:42 user devstack@n-api.service[61861]: X-User: tempest-VolumesActionsTest-1048592318-project-member Apr 11 23:55:42 user devstack@n-api.service[61861]: X-User-Domain-Id: default Apr 11 23:55:42 user devstack@n-api.service[61861]: X-User-Domain-Name: Default Apr 11 23:55:42 user devstack@n-api.service[61861]: X-User-Id: 4660aa9abec348f5a999a753be05b3e7 Apr 11 23:55:42 user devstack@n-api.service[61861]: X-User-Name: tempest-VolumesActionsTest-1048592318-project-member Apr 11 23:55:42 user devstack@n-api.service[61861]: method: > Apr 11 23:55:42 user devstack@n-api.service[61861]: exception: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. Apr 11 23:55:42 user devstack@n-api.service[61861]: action_args: {'id': '947314be-5091-4765-9855-5dd715371680'} Apr 11 23:55:42 user devstack@n-api.service[61861]: {{(pid=61861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. Apr 11 23:55:42 user devstack@n-api.service[61861]: ERROR nova.api.openstack.wsgi Apr 11 23:55:42 user devstack@n-api.service[61861]: DEBUG nova.api.openstack.wsgi [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] Returning 404 to user: Instance 947314be-5091-4765-9855-5dd715371680 could not be found. {{(pid=61861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 23:55:42 user devstack@n-api.service[61861]: INFO nova.api.openstack.requestlog [None req-d74452bb-b5c1-4c77-9a6c-2af74199e391 tempest-VolumesActionsTest-1048592318 tempest-VolumesActionsTest-1048592318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680" status: 404 len: 111 microversion: 2.1 time: 0.113850 Apr 11 23:55:42 user devstack@n-api.service[61861]: [pid: 61861|app: 0|req: 385/1157] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 23:55:42 2023] GET /compute/v2.1/servers/947314be-5091-4765-9855-5dd715371680 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)